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U INTRODUCTION 


1.1 0ACK6R0UN0 

This repoH describes the results of the Domestic Crops and Land Cover classi- 
fication and clustering study on area estimation. The objectives of the study 
are as follows; 

Task 1; To understand the current crop area estimation approach of the Econom- 
ics and Statistics Service (ESS) of the U.S. Department of Agriculture 
(USDA) in terms of the factors that are likely to influence the bias 
and variance of the estimators. 

Task 2; To develop and evaluate alternative clustering, classification, and 
regression methods that could be inserted into the current ESS 
estimation procedure. 

Task 3; To begin studies that may lead to an improved estimation procedure. 

Task 1 was intended to support Task 2 by providing a working understanding of 
the current ESS crop estimation approach. Such understanding is needed in 
designing appropriate experiments for evaluating and comparing alternative 
components, 

Consideration of these alternative methods in Task 2 was principally motivated 
by two factors. First, it was believed that a more theoretically based clus- 
tering algorithm would be appropriate. In particular, the CLASSY algorithm 
developed at the Lyndon B. Johnson Space Center (JSC) had performed well in 
tests and was the candidate clustering replacement. CLASSY is an adaptive max- 
imum likelihood clustering algorithm which models the overall data distribution 
as a mixture of multivariate normal s. in addition to its clustering proper- 
ties, CLASSY can also be used to provide direct area estimates. A second fac- 
tor was the belief that the Editor procedure should ideally use independent 
data sets for developing the regression equation and evaluating area esti- 
mates. One way to do this would be to divide the available data into training 
and test portions. Alternativelyi this could be accomplished by generating 
quasi -independent segments for regression using a jackknifing technique. The 
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Mean Square Error (MSB) elassifler lends Itself well to this use, as It makes 
no parametric assumptions', thus, there are fewer parameters estimated with the 
alporithm, implying more stable parameter estinittites. It was felt that, due to 
this robust nature, the MSE classifier would be more extendible to an inde- 
pendent test set. 

1.2 CURRENT USDA PROCEDURE 

The current USOA acreage estimation procedure comprises registration and 
digitization of ground truth and raw Landsat data, development of an estimator 
on the portions of the area of interest for which ground truth is available, 
and application of that estimator to the whole area of interest. This study is 
concerned with the procedure used in developing the estimator. 

The acreage estimation procedure involves the following steps: 

a. A registered raw data set for the area of interest for which ground truth 
is available is selecte^:. The data could be uni temporal or multi temporal, 
and, usually, both are studied. The data set is separated by crop type. 

It is optionaT to remove border pixels, poorly reeistered fields, poorly 
reported fields, and pixels with extreme spectral values relative to the 
rest of the crop type. 

b. Each ground truth crop is clustered separately, yielding a group of 
clusters with known cluster labels. 

c. Several options are excereised and parameters specified. Among those are; 

(1) specifying the minimum and maximum number of clusters per crop type 

(2) specifying separability of clusters in spectral space 
13) specifying percent convergence when combining clusters 
(4) specifying a priori probabilities 

(51 seeding clusters 

(6) pooling the resulting clusters 

(Ti dropping clusters with small pop alations 

(8) not clustering crops with small populations 
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d. After the training set has been clustered, ft fs then classified; and, for 
each crop, a regression Is performed between the ground truth and the num- 
ber of pixels classified Into that crop class* 

e. Based on the r^ of the regression, the percent correctly classified, and the 
time available, the analyst may repeat earlier steps with different 
parameters or options, or may drop crop types being clustered in an effort 
to tncrease the r^ and the percent correctly classified. Thus, for each 
crop, a regression estimator Is obtained which will predict the amount of 
ground truth present in the area of Interest when that area Is classified. 

1,3 STANDARIZED PROCEDURE 

For this study, It was necessary to standardize the use of the USDA crop 
estimation procedure so that alternative clustering and classifying components 
could be evaluated. The following options and parameter values wore 
recommended through discussions with USDA analysts; 

a. Specifying a priori probabilities. 

b. Clustering only crop types with a miniinum of 200 pure pixels available. 

c. Clustering pure pixels only. 

d. Removing pixels with extreme spectral values relative to others of the same 
ground truth crop type. 

0, Specifying a minimum and a maximum number of clusters per crop type (from I 
to 15) and a minimum cluster population (from 150 to 200 pixels) 

f. Specifying separability of clusters In spectral space to be in the range of 
O.t to 0.8, 

g. Specifying convergence when combining clusters to be within the range of 95 
to 99 percent. 

With these recommendations and a desire to choose an exact procedure, the USDA 
Editor software was exercised on data provided by the USDA. For this data set, 
a priori probabilities for each crop clustered were specified as the proportion 
of that crop present In the training set. 
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CluisteHng wa$ done on pure pixels only, and pixels with extreme values were 
omitted (clipped) from the clustering process* One analyst performed all 
clipping 1n this study for consistency. The clipping limits used for each crop 
type for each part of this study can be found In appendix A. To ensure a 
minimum of 150 to 200 pixels per cluster, the maximum number of clusters was 
specified as the number of pixels divided by 100, with no more than 15 clusters 
allowed. The minimum number of clusters was specified to be the maximum number 
of clusters divided by 3. A separabililty of 0.76 was used and was sparely 
reached before the clustering procedure stopped due to reaching the specified 
minimum number of clusters. A convergence of 05 percent provided adequate 
clustering without unduly Increasing the computer time. 

Ail other options In the standardized procedure were as recommended by the USDA 
analysts. All files generated during this study on the USDA Editor were 
archived on tape and will be available for at least 1 year, A list of these 
files is presented in appendix E, Comparison of results from this standardized 
procedure with the ESS Missouri analysis results are presented In section 3. 
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2. DATA SET 


2.1 DESCRIPTION 


The Landsat data used In this study included 33 segments in northwest Missouri, 
each having an area of approximately 1 square mile (259 hectares). These 
segments were all contained in strata 10 (50 to 100 percent agriculture) and 
had little cloud cover. Data were available for two dates: May 14 and 

August 3, 1979. An additional 12 segments from the August date were available 
but not analyzed because of heavy cloud cover. The counties represented in the 
Missouri data set are listed in table 2-1. The ground truth proportions in the 
33 analyzed segments are given in table 2-2. 


TABLE 2-1.- SEGMENTS PER COUNTY IN 
MISSOURI DATA SET 


County 

Daviess 

Harrison 

Putnam 

Schuyl er 

Mercer 

Cal dwel 1 

Gentry 

Sullivan 

Linn 

Livingston 
Grundy 
De Kalb 

Total 


Number of 
segments 

5 

5 

2 

3 

3 

3 

4 

4 

5 

■ 5 

3 . : 

__3 

45 



TABLE a-2.- GROUND TRUTH PROPORTIONS OVER 33 SEGMENT^i 


Crop 

Mixed 

Pure* 

Hectares 

Pi xel s 

Proportion 

Hectares 

Pixels 

Proportion 


Permanent 
pasture 

Soybeans 

Dense 
woodl and 

Other 

hay 

Other 

Total 



1321.5 3984 

1073.2 3299 

355.3 1136 

304.5 964 

681.5 2059 

4374.7 13476 


,072 

.153 

1.000 


821.3 
576,9 

167,0 

192.4 
64,2 

2031.5 


*Pure == Poorly registered, poorly reported, and border pixels removed 













The major crops in this study are corn, soybeans* and pasture, which represent 
about 12, 25, and 30 percent of the crops present in each sepment, respec- 
tively. Three additional crops are also studied; winter wheat (3 percent), 
dense woodland (8 percent) and other hay (7 percent). About 15 percent of the 
segments consisted of other crops , mainly wasteland. For a given crop, the 
minimum number of pure pixels considered for analysis was 200. The crops 
lumped together as "other" had well below 200, and other hay, dense woodland, 
and winter wheat were marginal. The best performance (as measured by percent 
correctly classified) in most cases was obtained for permanent pasture, in 
which over 2500 pure pixels were available for training. 

Listed in table 2-3 are the number of pure pixels present in ground truth in 
each of the 33 segments used in this study, broken down by crop type. The 
sample mean and sample standard deviation are also listed. 

The Missouri data set provided by the USDA was available at the Bolt, Beranek, 
Newman (BBN) remote processing center in Boston, where the USDA Editor software 
also resided. The same Missouri data set was placed on tape and sent to the 
Laboratory for Applications of Remote Sensing (LARS) at Purdue University. 
Software for alternate clustering and classification used in this study was 
located at LARS, The Missouri data sets at both BBN and LARS were identical. 
The following information for each pixel was provided in the data set: 

a. four channel values from May 14 

b. four channel values from August 3 

c. ESS crop code 

d. segment number 

e. tract and f i el d identification 

f. Landsat row and column 

g. flag indicating a border pixel 
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TABLE 2-3.- PURE PIXELS OF GROUND TRUTH BY SEGMENT 


Sefnent 

nuntber 

Corn 

i 

Winter 

wheat 

Permanent 

pasture 

Soybeans 

Dense 
wood! and 


6034 

^ 5 1 

' 7 1 

45 

13 

0 


6Q8S 

-0 1 

0 I 

165 

22 

0 

72 

6015 ; 

31 

W I 

30 

81 

0 

8 

6038 

0 i 

0 

0 

0 

0 

0 

6098 

0 

1 

0 

310 

0 

0 

0 

60/3 

27 

i 

41 

1? 

77 

33 

9046 j 


0 1 

99 

0 

47 

36 

6064 

0 

7 i 

46 

76 

40 

0 

6065 

29 

3 j 

28 

1 

0 

15 

6095 

0 1 

0 

0 

0 

0 

0 

9061 

86 

0 

0 

183 

0 

0 

9036 

5 1 

1 

3 

36 

125 

0 

0 

6053 

1 

0 i 

0 

40 

104 

4 

4 

■ 6058 

12 

0 1 

0 

171 

2 

35 

9057 

0 

0 i 

108 

17 

14 

45 

9037 

17 

26 

79 

67 

2 

2 

9062 

8 

0 1 

251 

18 

30 

16 

9066 

0 

8 j 

0 

79 

0 

0 

6045 

6 

“ ! 

340 

13 

0 

0 

904/ 

59 

43 i 

42 

152 

3 

Q 

6048 

S3 

0 

7 

0 

62 

0 

9097 

6 

0 

12 

82 

1 

62 

9096 

37 

0 

0 

26 

39 

28 

6040 

9 

2 

124 

f , 

22 

8 

55 

6060 

0 1 

1 ^ 

0 

10 

3 

6 

6035 

51 

5 

84 

125 

0 

34 

9016 

93 

0 

0 

85 

0 

0 

9051 

0 

35 

145 

9 

115 

0 

6063 

22 

2 

31 

76 

16 

0 

6050 

34 

0 

182 

0 

0 

79 

9052 

39 

19 

26 

137 

0 

0 

6059 

0 

0 

115 

18 

44 

14 

9017 

22 

13 

; 141 

46 

7 

10 

Total 

1 651 

192 

2527 

1775 

514 

592 

Sample 

mean 

19.7 

i 

5.8 

1 ■ ■ 

76.6 

53.8 

15.6 

17.9 

Sample 

SO* 

25,2 

10.8 

I 

90.1 

55.8 

27.3 

23.4 


2-4 


*Standard deviation 







2.2 PHILOSOPHY OF EXPERIMENTS 


The experiments were designed to understand the performance of Editor and to 
compare performance when alternative components are inserted. To motivate the 
analysis j two main variables X and Y can be considered, where X is the crop 
acreage derived from the classifier (or the number of classified pixels, 
depending upon choice of units) and Y is the corresponding ground truth acreage 
for the segment. In the current method of analysis, Y is regressed onto X, as 
if X were a fixed variable. Also, the reoression is developed on the training 
set Instead of an Independent sample. Certain subtle and often overlooked 
features of the classified variable X are not accounted for in the current 
method of analysis. In particular, the values which X assumes are a function 
of 


a. The observed spectral values and ground truth labels of the segments used 
to calibrate the classifier (training set). This implies that X is a 
random variable since the training set is picked at f'andom. 

b. The number of observations in the training set. The larger the training 
set, the less sensitive the Glassifier is to the random selection process 
for picking the training set. 

Now let 


y il yll 





be two sets of classifier-derived acreages over two sets of randomly selected 
segments. Both sets of segments are assumed to have been picked from the same 
population. Ideally, Yj regressed onto XI, i = L,.*»,Np should be "about" the 
same as Y« regressed onto XV, i - following conjectures arise: 

a. If X| is obtained by classifying the training set and X| is obtained by 
classifying an independent set, the regressions will be different for 
"small" training sample sizes. 

b. If X| is obtained by classifying the training set and XV is obtained by 
classifying an independent set, then the Xl -values will be more closely 
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correlated with the Y^-values than will be the X^'-values. This point has 
bearing on the relevance of the r^ values obtained by Editor and reported 
by the USDA. 

c. If X|' is obtained through a jackknifing procedure and X!| Is obtained by 
classifying an Independent set, then the regressions of onto Xj and Y-| 
onto win be "about" the same* This conjecture is probably classifier 
dependent and is one of the reasons why a linear classifier was selected 
for study. 

2,3 DESIGN OF EXPEIUMENTS 

In keeping with the conjectures presented in the Philosophy of Experiments 
section, the design of experiments was done In three levels. The first level 
consisted of training and testing on all 33 segments. This corresponds to the 
current USDA estimation procedure. In the second level, the data set was 
partitioned into a training set and a test set to assess the performance and 
the validity of the current USDA estimation procedure. Jackknifing techniques 
were used in the third level as a means of obtaining independent test sets 
which were larger than those obtainable by using a single tralning-and-test 
partitioning of the data. This experimental design was strongly influenced by 
the belief that the sample of segments chosen to obtain estimates Is a critical 
part in the whole estimation process. 

Many of the experiments were run in parallel as a means of comparing alterna- 
tive components. That is, the standardized USDA procedure was first run on a 
data set, and the procedure was repeated with the only change being the use of 
the CLASSY clustering algorithm to generate cluster statistics which were then 
inserted into the Editor system. Then a corresponding analysis was performed 
using the MSE classifier software. One experiment was designed for the USDA 
Editor to specifically evaluate one particular method of estimation, namely 
j ackknif i ng. A separate jackkni fing experiment for the MSE cl assi f i er was 
designed. The experiments are described below in further detail; and, unless 
explicitly stated, all analysis is with multi temporal data. 


a. 3.1 TRAINING AND TESTING ON ALL 33 SEGMENTS 


The current USDA method of training on a sample and developing the regressions 
on the training set was performed using all 33 segments. The following 
comparisons were made; 

a. Comparison of uni temporal versus mul t1 temporal - The entire estimation 
process was carried out for uni temporal data and for multi temporal data 
within the current Editor system. Summary statistics were collected. The 
Hotelling's T^ test was used to determine If mul t1 temporal data produced 
significantly better estimates than unitemporal* This test Is described In 
detail 1n section 3.1.2, 

b. Comparison of the current standarized USDA procedure versus the CLASSY 
clustering algorithm - The entire estimation process was performed using 
the standarized USDA procedure. The process was repeated but with CLASSY 
cluster statistics inserted into the Editor system. Summary statistics 
were collected. The Hotelling's T^ test was used to determine if the use 
of GLASSY produced significantly better estimates on the training set than 
the current USDA procedure. 

c. Comparison of the current standarized USDA procedure versus the MSE 
classifier The entire estimation process was performed using the MSE 
classifier software. Summary statistics were collected. The Hotelling's 
T^ test was used to determine if the use of the MSE classifier produced 
significantly better estimates on the training set than the current USDA 
procedure. 

2.3.2 TRAINING ON 25 SEGMENTS AND TESTING ON 8 SEGMENTS 

The data set was divided into two sets: a training set of 25 segments used to 
develop a classifier and a test set of 8 segments independent of the training 
set. The classifier developed on the training set was used to classify both 
the training and test sets* Regressions for the six crops of Interest were 
developed on the training set and also on the test set* This was carried out 
with the standardized USDA procedure and again with CLASSY as a component of 
the Editor system, and finally with the MSE classifier software. Summary 
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statistics a''e presented in later sections, The followinq tests and 
comparisons were made; 

a. For each of the three classification choices, an F«test was performed to 
deterinine if the regression line developed on the training set for a given 
crop was equal to the regression line developed on the test set. (A 
preliminary test for homogeneity of variance must be carried out first.) 
This test indicates if the regression line developed on the training set is 
extendible to the test set, A discussion of this test appears in 
section 3,2.1, 

b. The current USDA clustering procedure was compared with the ClASSY cluster- 
ing algorithm. The Hotelling's T^ test was perfonned to determine if the 
use of CLASSY produced significantly better estimates on an independent set 
than the USDA procedure. The estimates for the independent set were ob- 
tained from the regression line, which was developed on the training set, 

c. The current USDA classification procedure was compared with the MSB classi- 
fication, The Hotening's T^ test was performed to determine if the use of 
the MSB classifier produced significantly better estimates on an indepen- 
dent set than the USDA procerture. 

2.3.3 OACKKNIKINO 

Jackknifing techniques were used to simulate the procedure of training on a 
sample and developing regressions on an independent set. The following 
experiments were condurted. 

a , Jackknifi n g within the Editor system 

By repeating the division of the data set into training and test portions 
so that all segments appear exactly once in a test group, the combined test 
groups from all repetitions represent a quasi-inriependent test set. 

Summary statistics and regressions were obtained from this quasi-indepen- 
dent test set and were compared to results obtained when traininq and 
testing on all 33 segments. Details of this jackknifing are given in a 
later section. 
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b* Jackknifing with the MSE classifier 

The data set was divided Into sets consisting of 25 and 8 segments. The 
set of 25 segments was further divided into a set of 24 training segments 
and a set of 1 test segment. This division of the 25 segments was repeated 
so that each of the 25 segments appeared exactly once as a test segment. 
These test segments were combined to form a quasi’^independent test set of 
25 segments. The Hotelling's T^ test was performed to determine if the 
regressions developed on the quasi •^independent test set produced signifi- 
cantly better estimates on ^.n independent set than did the regressions 
developed on the 25 segments without iackknifing. For each crop, an F-test 
was performed to detennine if the regression line developed on the quasi- 
independent test set was equal to the regression line developed on an 
independent test set. Details of this jackknifing appear In section 5.6, 
Cross-Val i dation Procedure 

2.4 SELECTION OF TRAINING AND TEST SEGMENTS 

Before training and test segments were selected, the geography, strata 
boundaries, and the Landsat imagery of the area covered by the 33 segments were 
studied. These segments, when plotted on a topographic map of Missouri, covered 
a rectangular area roughly 100 miles (160 kilometers,) on a side. This 
rectangle represented apout one-eighth of the land area in Missouri. About 
three-quarters of the segments were 800 feet (244 meters) in elevation. The 
remaining segments were scattered around the perimeter at 1000 feet 
(305 meters). 

The geography was rolling. No major urban areas were nearby. A copy of the 
topographic map is included in appendix B. Some cloud cover was at the edge of 
the scene, but very little was over the segments. A fairly uniform color 
distribution prevailed. 

County maps with strata boundaries were provided by the USDA, with the 33 seg- 
ments identified on them. All 33 segments were in strata 10. Very few were 


n$ar the strata boundaHes, and the segments were evenly dfstrlbuted over the 
counties (see table Z-X). 

There were, then, two factors in the choice of training and test segments, both 
related to geography. It is assumed that if soil characteristics vary over the 
region, they will be most different between segments that are widely separated 
geographically. Also, segments located at the extreme edges of the region were 
slightly higher in elevation. Therefore, to obtain representative training 
segments and representative test data, each group of segments should be 
distributed uniformly over the geographic region covered by all 33 segments. 

Eight independent test segments were chosen by laying out a uniform grid with 
eight boxes over the topographic map, One segment from each box was randomly 
selected, The remaining ZB segments constituted the training group, listed in 
tables 2-4 and 2-5 are the segment number and ground truth crops present (in 
pixels) for the test and training groups, and the comparisons with all 
33 segments , 

These groups wore found satisfactory, since they are both fairly representative 
of the total data set of 33 segments and still provide some variation. 

To further validate that the 25 training segments are representative of the 
entire data set, the percent of the training set correctly classified when 
training with sep'sents and wUit all segmonts a»*e presented in table 2-6. 
The similarity of these results are indicative that the 25 training segments 
are representative. 

In the Editor jackknifing experiment, it was necessary to partition the data 
into 11 groups of 3 segments each. This was accomplished by laying a grid with 
three boxes over the topographic map such that 11 segments fell into each box, 
Three segments were then chosen randomly, one from each box. This was repeated 
10 times, obtaining 11 test groups of 3 segments each. Each corresponding 
training group was composed of the remaininq 30 segments. Mean values for each 
of the 11 test and groups can be found in appendix D. 
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Segment no, 

Corn 

winter 

wheat 

6015 

31 

19 

6034 

5 

7 

6035 

51 

5 

6040 

9 

2 

6045 

6 

0 

6050 

34 

0 

6053 

0 

0 

6058 

12 

0 

6060 

0 

0 

6063 

22 

2 

6064 

0 

7 

6065 

29 

3 

6073 

27 

0 

6085 

0 

0 

6095 

0 

0 

9061 

86 

0 

9036 

5 

3 

9047 

59 

43 

9051 

0 

35 

9057 

0 

0 

9016 

93 

0 

9062 

8 

0 

9066 

0 

a 

9096 

37 

0 

9097 

6 

0 

Total 

520 

134 

Mean of 25 

20.8 

5.4 

Mean of 33 

19,7 

5.8 

SO of 25 

26.8 

! 11.0 

SO of 33 

25,2 

10.8 


Permanent 

pasture 


Soybeans 


Dense 
wood! and 




57.2 

55.8 


27.9 

27.3 


25.3 

23.4 


















2.5 SAMPLE SIZE ESTIMATES 


Table 2-7 gives the sample sizes needed to detect different amounts {10, 15, 
and 20 percent) of deviation from the average ground truth at various levels of 
type I error (a) and type II error (d) for each of the six crops. For each 
crop and for a given amount of deviation, the sample size was obtained by 
solving two simultaneous equations which relate the type I and type II errors 
to the sample size and the critical value. The equations were based on the 
standardized normal distribution. 


TABLE 2-7. • UNIVARIATE SAMPLE SIZE ESTIMATES 


Crop 

Average 

ground 

truth 

MSE 

A Percent 

a * 0.05 

a 

» 0.1 


8*0.1 

0-0.2 

0-0.3 

0*0.1 

0*0.2 

0-0.3 

Corn 

15.909 

68.165 

0.1 

231 

167 

127 

177 

122 

88 




.15 

103 

74 

57 

79 

54 

40 




.20 

58 

42 

32 

45 

31 

22 

Winter 

4.365 

24.577 

0.1 

1104 

797 

608 

846 

580 

421 

wheat 



.15 

491 

355 

270 

375 

258 

187 




.20 

276 

200 

152 

212 

145 

106 

Permanent 

40.047 

320.887 

0.1 

172 

124 

95 

132 

90 

66 

pasture 



.15 

77 

55 

42 

59 

40 

29 




.20 

43 

31 

24 

33 

23 

17 

Soybeans 

32.522 

128.773 

0.1 

105 

76 

58 

80 

55 

40 




.15 

47 

34 

26 

36 

25 

18 




.20 

27 

19 

: 15 

20 

14 

10 

Dense 

10.768 

83.933 

0.1 

620 

448 

341 

475 

326 

236 

woodland 



.15 : 

276 

199 

152 

^ 211 

145 

105 




.20 

155 

112 

86 

119 

82 

59 

Other hay 

9.228 

92.370 

0.1 

929 

670 

511 

711 

488 

354 




.15 

413 

298 

228 

316 

217 

158 




.20 

233 

168 

128 

178 

122 

89 
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Table 2-8 gives the sample sizes needed to detect different amounts (10, 15, 
and 20 percent) of deviation from the ground truth mean vector at type I error 
{«= 0.05) and various levels of type II error ( 3) when all six crops are 
considered simultaneously. For a given amount of deviation, the sample size 
was obtained by solving two simultaneous equations which relate the type I and 
type II errors to the sample size and the critical value. The equations were 
based on central and noncentral Hotelling's T^ distributions. 


TABLE 2-8.- MULTIVARIATE SAMPLE SIZE ESTIMATES 


A percent 

a = 0.05 

0,1 

5-0.075 3=0.187 3=0.220 3=0.295 

46 36 34 30 

0,15 

3=0.083 3=0.184 3=0.264 3=0.367 

24 20 18 16 

0.20 

3=0.11 * * * 

16 


*No values. 
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3. EVALUATION OF STANDARDIZED USDA PROCEDURE 


3.1 analysis results for training and testing on 33 SEGMENTS 
3.14 comparison WITH USDA RESULTS 

In tables 3-1, 3-2, and 3-3 are listed the omission error, the Gommission 
error, the residual MSE, and the r^ of the regression for each crop from runs 
made with the standardized procedure and all 33 segments for training (columns 
headed JSC). Also included (when available) for comparison are figures provided 
by the USDA from similar runs made by USDA analysts (columns headed USDA). 

The percent correctly classified is equal to one minus the omission error. 

From the omission and commission errors, it is apparent that the August acqui- 
sition provided better results than the May acquisition. In section 3.1.2, a 
multivariate statistical test was performed to determine if mul ti temporal data 
provided significantly better estimates than the August data. 

3.1.2 HOTELLING'S T^ TEST COMPARING UNITEMPORAL AND MULTITEMPORAL ESTIMATES 

To compare the performance of the standardized USDA procedure using different 
types of data, namely unitemporal and multi temporal , a criterion to measure the 
performance must first be defined. The criterion adopted in this study is a 
vector consisting of the absolute differences between the ground truth and the 
regression estimate for each of the six crop types of interest. Multivariate 
statistical analysis techniques have been applied, because the major objective 
is to evaluate the performance of the procedures in classifying and estimating 
the crop hectarage of all six crop types simultaneously. To compare the 
uni temporal and multi temporal results, a test is made of the equality of the 
two mean vectors of the absolute differences (vectors of means of the absolute 
value of the differences.) If the hypothesis of equal mean vectors is 
rejected, the type of data yielding a smaller mean vector of absolute dif- 
ferences between the ground truth and the regression estimate is preferred. 
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Crop 

r 

2 

Percent 

correct 

Omission 

error 

Commission 

error 

Re si 
MSI 


JSC 

USDA 

JSC 

USDA 

JSC 

USDA 

JSC 

USDA 

JSC 

Corn 

0.80 

0.82 

0.73 

0.67 

0.27 

0.33 

0.37 

0.24 

68.2 

Winter 

wheat 

.38 

.52 

.29 

.34 

.71 

.66 

.56 

.44 

24.6 

Permanent 

pasture 

.79 

.80 

.79 

.75 

.21 

.25 

.46 

.36 

320.9 

Soybeans 

.85 

.85 

.79 

.78 

.21 

.22 

.33 

.23 

128.8 

Dense 

woodland 

.62 

.65 

.47 

.47 

.53 

.53 

.54 

.44 

83.9 

Other hay 

.20 

.48 


.32 

.78 

.68 

.60 

.52 

92.4 



TABLE 3-2.- EDITOR AUGUST PERFORMANCE MEASURES FOR 
TRAINING AND TESTING ON 33 SEGMENTS 



Winter 

wheat 


Permanent 

pasture 


Soybeans 


Dense 

woodland 



£SC USDA 
0.42 0.37 


.27 .30 


.74 .75 

.75 .75 


Other hay 


*No values. 


,44 .44 

.03 .18 


Percent 

correct 


JSC USDA 


0.52 0.43 


Omission 

error 

JSC 

USDA 

0.48 

0.57 

.66 

.70 

.27 

.27 

.26 

.26 

.68 

.66 

.92 

.88 


Commission 

error 


JSC USDA 
0.55 0.47 


.52 .44 

.37 .29 


.58 .51 

.79 .73 


Residual 

MSE 

JSC 

USDA 

197.8 

* 

28.8 

ic 

391.5 

•k 

214.0 

k 

125.8 

k 

111.4 

k 






.79 


.73 









































TABLE 3-3,- EDITOR MAY PERFORMANCE MEASURES FOR 
TRAINING AND TESTING ON 33 SEGMENTS 


Permanent 

pasture 

Soybeans 

Dense 
woodl and 

Other hay 


r 

2 

Percent 

correct 

Omission 

error 

Commission 

error 

Residual 

MSE 

osc 

USDA 

JSC 

USDA 

JSC 

USDA 

JSC 

USDA 

JSC 

USDA 

0.07 

0.35 

0.26 

0.18 

0,74 

0.82 

0.76 

0.58 

313.4 


.01 

.12 

.02 

.09 

.98 

.91 

.88 

.66 

39.0 

it 

.58 

.74 

.68 

.77 

.32 

.23 

.51 

.44 

648. 9 

it 

.61 

.63 

.67 

.72 

,33 

.28 

.52 

.42 

326.4 

it 

.44 

,44 

.33 

.24 

.67 

.76 

.65 

.53 

125.2 

it 

.05 

.20 

.16 

.19 

.84 

.81 

64 

,64 

109.1 

it 



















The hypothesis is now formulated and tested as fonowst 
Let 





»^A2 


^B2 

^A3 

; Ug ** 

‘^(33 

“A4 

*"B4 

>^A5 


^B5 

l'A6 


3i 


where 


( 1 ) 



the mean of the absolute difference between the ground truth and 
the regression estimate of crop i from the USDA procedure using 
mul ti temporal data, 


lig^. = the mean of the absolute difference between the ground truth and the 
regression estimate of crop i from the USDA procedure using uni temp- 
oral data, (crop 1 is corn; crop 2 is winter wheat; crop 3 is permanent 
pasture; crop 4 is soybeans; crop 5 is dense woodland; crop 6 is other 
hay.) 


It is desired to test 


Hi: - ug ^ 0 


( 2 ) 


It is assumed that a random sample of 33 segments was chosen. Cl asslFi cation 
hds been performed; and ground truth, classification results, and regression 
estimates were obtained for each of the 33 segments. Let 







iiff "r ^ 


where 


Y-jj = the ground truth of crop 1 In segment j 

A 

^Alj " regression estimate of the ground truth of crop i in segment j from 
the USDA procedure using multi temporal data 

A 

Ygij s the regression estimate of the ground truth of crop I in segment j from 
the USDA procedure using uni temporal data, I 6 


To test the hypothesis, the vectors formed are 






2j 

3j 

4j 

5j 

6J 


- ''Aljl 

- 

■ ^Blj 

■ \zs ' 

- 

A 

" ^B2j 

- ^3jl 

- I''3J 

" '^"b3o 

^A4j^ 

■ l''4d 

■ ^"b4j 

■ ^A5j' 

- I’'5j 

" ^B5j 

“ ^A6j' 

■ l’'6j 

" "^B6j 


The Hotel Ting's T^ testing statistic is given 

T^ = N a 


0 = 1,m.,33 (4) 


(5) 


where 

N = sample size 
1 N 

3 = i S “j 

0=1 ^ 

S(j = the sample variance"Covariance matrix of dj 

The computed T^ =44*8324, and T^g^Og (6,32) = 17.4. Since T^ > T^o.os (6.32), 
we reject Hg ; - pg = 0 at the 0.05 level of significance and conclude that 

the mean vectors of absolute differences are not the same for multi temporal and 
uni temporal data!' And since 
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( 6 ) 


-5.35394 


T 

-0.40394 


0 

-0.81182 

< 

0 

-3.14828 


0 

-1.89091 


0 

-1.14818 

L.. 


0__ 


it indicates that the regression estimates obtained from multi temporal data 
seem to be closer to the ground truth for all crop types than the regression 
estimates obtained from uni teinporal data. It is therefore expected that 
multi temporal data will produce better estimation results. 

3.2 EVALUATION ON AN INDEPEHDENT TEST SET 

3.2.1 TRAINING ON 25 SEGMENTS AND TESTING ON 8 SEGMENTS 

One of the purposes of this study was to evaluate how well a classifier and the 
regression equations whiOh wev'e developed on the training set performed on an 
independent test set. Of the 33 segments available for analysis, 8 were chosen 
as a test set. The reinaining 25 segments were then used in the standardized 
USDA procedure to train a classifier and to develop the regression equations 
for the six crops being studied. Performance measures of this classifier on 
the 25 training segments and on the 8 test segments are given in table 3-4. 

Also listed in this table are the r^' 5 (r - the correlation coefficient) and 
the regression MSE's for each crop in both sets of segments. This table shows 
that the training set had lower omission and commission errors for each crop 
than did the tost set, with the exception of other hay. Also, the training set 
yielded higher r^'s than the test set, with dense woodland as the only 
exception. Both dense woodland and other hay are considered minor crops in 
this study. Finally, the overall percent correct is 57.70 for the training set 
as compared to 42.00 for the test set. 

To determine whether the regression lines fitted to the 25 segments in the 
training set wene appropriate for predicting ground truth in the 8 independent 
test segments, a two-stags F-test was performed for each crop. This test is 
constructed to determine if the regression line developed on the training set 
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is significantly different from the regression line developed on the test 
set. The structure of this test requires that the residual sum of squares for 
each line be pooled to form a common variance estimate. Thus, homogeneity 
tests for the error variances of the training and test sets must first be 
performed. These tests are outlined below. 

Assume that the linear relationship between the ground truth and the number of 
pixels classified for the training set is given by 

^1 “ ^l^i ®TRAIN 
and for the test set is given by 

Yi * ag + bgX^. + (8) 

where end are the random errors of the models, with variances 

o 2 

‘^TRAIN ‘^TEST* hypothesis for testing homogeneity of variances is 
stated as; 

^0' ^ESt “ ^ (g) 

Hi; 4 rAIN 

The testing statistic is E - *^^^TEST ’^^^'TRAIN 

the residual mean square errors obtained by separate regressions on the test 
set and the training set, respectively. The null hypothesis Hq is rejected at 
level 0.10 if E > F(0.q8,6,23) « 2.S1 or if F < 1(0,05,6,23) -0.260. 

If the homogeneity of variances is not rejected for a crop, then the following 
hypothesis is tested; 

Hq: training set regression line = test set regression line 
Hii training set regression line test set regression line 

The testing statistic is 

^^^ALL " ^^^TRAIN " ^^^TEST 
^^'"TRAIN ^'HeST 

: : ■ • 3 - 8 ; • ■ ■ 





where SSEy^-gy, S^^jRAIN’ residual sums of squares obtained 

by separate regressions on the test set, training set, and combined test and 
training sets, respectively. The null hypothesis Hq Is rejected at level 0.05 
If F > F(0. 95,2,29) * 3.32. Results for these two tests for the six crops are 
given In table 3-5 (page 3-11). Homogenel ty of variances was rejected for the 
major crops of corn, permanent pasture, and soybeans. Of the three remaining 
crops, the equality of the training set regression line and the test set 
regression line was rejected for the crop other hay. 


In the first part of this section, F-tests were performed to determine if the 
regression line developed on the training set was significantly different from 
the regression line developed on the test set. These tests provided Infor- 
mation as to the extendiblllty of the area estimation procedure which Is 
currently being used by the USDA. In this section, an alternative method 1s 
presented with which to gain Insight Into the question of this extendablllty. 


As known from regression theory, an estimator for the model variance can be 
obtained by summing the squared residuals from the regression and then dividing 
this quantity by its degrees of freedom. A similar estimator is now 

An 

described. This estimator, denoted by a*” , is a weighted average of the 8 
squared residuals obtained when the regression equation from the 25 training 
segments Is used to predict the ground truth (Y) for the 8 test segments. The 
calculation Is given by 


where 

Yi 






1 + 


7E‘ 


(X* - 50^ 

75——— 
E (X| - X)2 
j=i ^ 


(U) 


ground truth hectarage for segment 1 in the test set, 
1 - 1,***,8 
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4^ 



I 


* estimated ground truth hectarage for segment 1 in the test 
set using the training regression equation as a predictor, 
i » !,•••, 8 

a number of classified pixels for segment 1 in the test set, 
1 a I , • • • ,8 

a the mean number of classified pixels per segment in the 
training set 



a the corrected sum of squares for the independent variable 
in the training set 


And 


E{«2) 


” 1=1 


’test 


,2 jl 

’TRAIN |2F 


(X^ - 50' 


n 

E (X 
j=i 


d 


50 ' 


+ (EY. 


EY.)^ 


1 ^^1 


o Y 2^ 

a) 


(12) 


£ (X, - nr 


j=l 


It can be seen that E(o'^) depends upon the training set through its variance 
and EY^r Likewise, tixr) depends upon the test set through its 
variance OjjrQ-j- and EYj , If the training set and test set share the same 
regression lino ^nd is a common variance, then 

E(cj^) a 0 ^. No formal tests were made using hut for a given crop if is 
considerably different from the MSE of the training set, it is an indication 
that ^ '^TEST the training set regression line is significantly 

different from the test set regression Tine, Table 3-6 lists the MSE' s of the 

* p ■ ■ 

six crops on the training set, which are unbiased estimates of the 


^2 

A1 so listed is o for each crop. For crops for which the homogeneity of 
variances was rejected in table 3-5, it appears that MSE's of the training set 
are quite different from their corresponding o' s. 
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TABLE 3-5,- EDITOR MULTITEMPORAL ANALYSIS; F-TESTS FOR 
HOMOGENEITY OF VARIANCES AND EQUALITY OF REGRESSION LINES 


Crop 

Computed F 
for homogeneity 
of variances 

Computed F 
for equality of 
regression lines 

Corn 

*7.043 


Winter wheat 

1.723 

2.66 

Permanent pasture 

*7.178 


Soybeans 

*3,308 


Dense woodland 

.505 

3.296 

Other hay 

,658 

■^3.383 

Critical values 

,260, 2.51 

3.32 


*Homogoneity of variances rejected. 
'^'Equality of regression lines rejected. 


TABLE 3-6.- EDITOR MULTITEMPORAL ANALYSIS: MEAN SQUARE ERRORS 
OF THE 25 TRAINING SEGMENTS AND qF THE 
8 TEST SEGMENTS 


Crop 

MSE 


Corn 

28.805 

147.517 

Winter wheat 

21.628 

43.449 

Permanent pasture 

176.736 

1025.186 

Soybeans 

119.426 

438.685 

Dense woodl and 

72.595 

88.132 

Other hay 

79.541 

110.431 
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3.2.2 aACKKNIFING WITH THE EDITOR SYSTEM 

Ideally, it is desirable to have a large saniple with which to train a classi- 
fier and another large saniple independent of the first with which to develop a 
regression line. The advantage of haying a large sample is that the sampling 
variability is reduced as the sample size increases. When it is impossible to 
have a large training sample as well as a large sample with which to develop 
the regression line, a jackknifing procedure can be employed. The jackknifing, 
which is now described, simulates the method of training a classtfier on a 
sample and then developing a regression on an independent sample. 

The 33 segments were grouped into 11 sets containing 3 segments each. One set 
of 3 segments became the test set, while the remaining 10 sets were pooled and 
used to train a classifier. The test set containing three segments was then 
Glassified, This procedure was repeated 10 more times, with each set of 
3 segments being the test set exactly once, and the remaining 30 segments being 
used to train a classifier. The 11 test sets were then combined, resulting in 
a sample of 33 segments, each having ground truth (y) and a classification 
variable (X). 

Regression eguations for the 5 crops of interest were developed on this com- 
bined set of 33 segments. The regression MSI's, r^-*s, and classification 
performance measurements are given in table 3-7 for this combined set. For 
comparison, the classification results obtained when all 33 segments were used 
to train the classifier are also given, With only one exception, the omission 
and commission error rates are higher in the jackknifed set than in the set 
where ail 33 segments were used in the training. Also, the r2*$ are lower in 
the jackknifed set. For the major crops of corn, permanent pasture, and 
soybeans, the decrease in r^ is 0.15, 0,23, and 0.14, respectively. The 
results of this jackknifing study indicate that the r^'s reported by the USDA 
are overestimated. 
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TABLE 3-7.^ EDlTflR MULTITEMPORAL CUSSIFiCATION PERFORMANCE MEASURES ON 
33 SEGMENTS VERSUS PERFOPrmNCE MEASURES ON THE JACKKNIFED TEST SET 
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4, EVALUATION OF THE CLASSY CLUSTERING ALGORITHM 


4.1 INTRODUCTION 


The CLASSY clustering algorithm Is an adaptive, maximum likelihood clustering 
procedure developed at JSC (refs. 1 to 4). The algorithm Is fundamentally a 
density estimation algorithm which approximates the overall data distribution 
as a mixture of multivariate normal distributions. That is, If x Is an 
observation vector and p Is Its probability density function, then 


p(x|m,]r^) 


m 


a|P|(x| 


r^) 


(13) 


where 

aj = a priori probability of occurrence of class 1 


p^.(xlji^. ,2^) s multivariate normal probability density function for class 1 with 

mean vector u and covariance matrix 

“1 ^ 
m = total number of classes 


’im 


= full set of parameters 
(i.e., {aj_,***,a^, ^i»****^mJ^ 


Given a set of statistically independent, unlabeled sample vectors {x . the 
likelihood function may be formed in the following manner: 


N 


L{{x.}|m,Tr_) = n 


j-1 


m 


(14) 


where N 1 s the total number of sampl es . 


So far, the assumptions and equations parallel the usual maximum likelihood 
development. In using CLASSY, the additional assumption is that each value of 
the parameters m and occurs with an a priori probability distribution 

A(m,ir^). This Bayesian formulation of the problem Is taken to avoid the 
degenerate situation of increasing the like! ihood by generating more and more 
clusters with smaller and smaller values of aj. The practical limit of this . 
process is that each class will be associated with only one data point. 
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In practice, the a priori probability has been chosen as 

m 

® '1 f'”' Im ‘ '*m 

0 otherwise 

where 

C| s a constant containing normalizing factors over space 

% 

(5 = overall normalization constant 

finite region of space corresponding to allowable values for the 
paraineters 




The objective of CLASSY, then, is to determine the discrete parameter m and the 
continuous parameter vector so as to maximize the following function. 


n 

L({Xj) ,m,Ti|^) * A(m,Tij^j) JI 

il "“I 


'm 


( 16 ) 


The value of m and which maximize equation (16) specify a set of dis« 
tributions called clusters. 

Many approaches may be taken to maximize equation (16). The approach chosen in 
CLASSY is to interleave the maximum likelihood iteration [designed to maximize 
L( |Xj} ,ni,fl|^) with respect to the continuous parameter vector jj] with a discrete 
split, join, and combine process [desiqned to maximize L( |x- 1 ,m,Ti|^^) 
respect to the discrete parameter m]. Although the theoretical convergence 
properties of this procedure have not been examined, it is expected that, by 
alternating these two techniques, values of m and j corresponding to at least a 
local maximum of L({x-|,m,ii|^) will be determined. Since the splitting and 
combining techniques operate around each existing cluster, and the statistics 
for hypotheses concerning different numbers of clusters are maintained 
separately, it has been observed that the final local maximum will often be 
global . 
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Necessary conditions for a maximum of L( {xj },m,TTj^) , assuming a fixed number of 
classes m, are well known [see Duda and Hart (ref. 5) and Wolfe (ref. 6)] and 
are given by the following equations; 




N 


nr 


Hi " ”F 


^E^P(1IXkP.V 

~ -—— — — 

^ p(i|Xk.%) 


(17) 


(18) 


(19) 


( 20 ) 


where p(i IXi^jUn,) is the posterior probability of class i, given the kth sample 
vector and the values of the parameters; and a|, and i = !•••# are the 
el ements of 


CLASSY uses a direct functional iteration to maximize equations (19) and (20); 
that is, estimates for and z. are used in the right-hand side to produce 
improved estimates on the left-hand side. Estimates for the a priori class 
probabilities, a|, are computed using an iteration scheme which has proved to 
converge more rapidly than the simple functional iteration using equation 
(18). The scheme used is descrTbed in reference 4. 


The optimization of L( {Xj} ,m,itj^^) with respect to the discrete parameter m 
generates hypotheses concerning the number of clusters and the subsequent 
testing of these hypotheses using a likelihood ratio test. At certain points 
in the process of maximum likelihood iteration, it is possible to generate a 
hypothesis concerning the fit of a given cluster to the data; namely, either 




that the data are better represented by two clusters rather than one (a split 
hypothesis) or that the data are better represented by combining the given 
cluster with another cluster (a join hypothesis). Each cluster is periodically 
checked throughout the program to see if either a split or a join hypothesis 
seems reasonable. Measures of skewness and kurtosis are compared against 
values expected for a single, norma! distribution to see if a split hypothesis 
should be considered. A measure of cluster similarity is used to determine if 
a join hypothesis is appropriate* 

Clusters may be eliminated as the result of a likelihood ratio test or if their 
estimated a priori class probability in the mixture falls below a set thresh- 
old. Details concerning the split, join, eliminate operations as well as the 
operation of the algorithm in a general may be found in references 2, 3, and 4. 

4.2 DESCRIPTION OF PROCEDURE 

In order to evaluate the ClASSV clustering algorithm as a replacement for the 
clustering algorithm currently used in the Editor system, two different 
experiments were performed. 

In the first of these experiments, GLASSY was used to cluster the pure pixels 
for each of the 6 test crops in the 33 Missouri segments. Unlike the 
standardized USDA procedure, outlying pixels and poorly registered fields were 
not removed before clustering. The resultant cluster statistics for each crop 
were transferred to the Editor system, and all pixels in the 33-segment area 
were classified using Editor's maximum likelihood classifier. Regression 
equations relating the classified pixels to the ground truth hectarage were 
developed for each crop. The performance measures for classification and 
regression, including the percent correctly classified, the omission and 
commission errors, and the r^ and MSE for regression are given in table 4-1. 

In the second experiment, CLASSY was used to cluster pure pixel data for each 
crop contained in 25 of the available 33 Missouri segments. The remaining 8 
segments were reserved as an independent test set for use in evaluating the 
classifier and regression equations developed using the 25 training segments. 


TABLE 4-l.« GLASSY MULTITEMPORAL PERFORMANCE MEASURES FOR 
TRAINING AND TESTING ON 33 SEGMENTS'^ 


Crop 

MSE 

r2 

% 

Correct 

Omission 

'Com- 

mission 

Corn 

23.33 

0.9308 

72.31 

27.69 

29.47 

Winter 

wheat 

22*07 

.4427 

38.05 

61.95 

58.35 

Permanent 

pasture 

239.79 

.8435 

75.45 

24.55 

45.50 

Soybeans 

85.95 

.8877 

81.57 

18.43 

34.01 

Dense 

woodland 

62.53 

.7195 

1 

49.74 

50.26 

51.50 

Other hay 

59.45 

.4845 

26.14 

73.86 

63.05 


*Overal1 % corFect 














The purpose of this expeflment was to determine if the performance of the 
hectarage estimation system on an independent data set was comparable to its 
performance on the training data set. The percent correctly classified, the 
omission and commission errors of the classifier developed on the 25 training 
segments and those from the 8 test segments are given in table 4“2. Similarly, 
the MSE and r^ for the regression equations developed separately on the 25 
training segments and on the 8 test segments are also given in this table. The 
last column in table 4-2 is an unbiased estimate of the error variance in 
applying the regression equation developed on the 25 training segments to the 8 
test segments. This is the same statistic described in section 3.2.1. 


In section 4.3, a statistical comparison is made of the hectarage estimates 
obtained when using ClASSY to cluster all 33 segments with the corresponding 
estimates using the standardized USDA procedure. In section 4.4, a similar 
statistical comparison is made for the estimates obtained for the eight 
independent test segments. Finally, in section 4.5, a test is made to 
determine whether the regression line developed on the 25 tratning segments is 
statistically different from a line fitted to the 8 test segments. 

4.3 COMPARISON OF CLASSY AND THE STANDARDIZED USDA PROCEDURE 


To compare the performance of GLASSY and the standardized USDA procedure, the 
criterion defined in section 3.1.2 and the Hotelling's T^ test on the mean 
vectors of absolute differences have been used. 


Let 


^^cT 

^C2 

^*C3 

^^C4 

^C5 

^C6 


( 21 ) 


where is the mean of the absolute difference between the ground truth and 
the regression estimate of crop i from the CLASSY procedure. 
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TABLE 4-2.- CLASSY MULTITEMPORAL CLASSIFICATION PERFORMANCE MEASURES FOR TRAINING 
ON 25 SEGMENTS AND TESTING ON AN INDEPENDENT SET 



*OveraTl % correct - 59.62 
'Overall % correct = 45.38 



We now test: 


H 


’O' 

1 ' 


Pa - 
Pa " 


(Jq a 0 


( 22 ) 


where 1s defined In section 3.1,2. The Hotelling's testing procedure for 
the above problem is similar to that described in section 3.1.2. The computed 
t 2 is 44.1959, and t2o.o 5(6»32) is 17.4. Since T^ > we 

reject Hq: Pa - Pq = 0 and conclude that the mean vectors of absolute 
differences are not the same for the two procedures. And since 


1.6969^ 


T 

0.36333 


0 

2,39 

> 

0 

0.37909 


0 

0.99424 


0 

2.0812)L 


0 


(23) 


indicates that the regression estimates obtained by using CLASSY seem to be 
closer to the ground truth than the regression estimates obtained by using the 
standardized USDA procedure, it is believed that the CLASSY clustering 
algorithm performs better than the clustering algorithm used in the 
standardized USDA procedure. 


4.4 COMPARISON OF CLASSY AND THE STANDARDIZED USDA PROCEDURE BY WEIGHTED MEAN 

wmw — : 


Another testing was done on the mean vectors of weighted absolute differences 
so that crops with larger ground truth proportions contributed more in 
distinguishing the difference between CLASSY and the standardized USDA 
procedure, The hypothesis is formulated and tested as follows: 




★ 


pQ * 0 


(24) 
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where 


^A1 


‘‘Cl 



★ 

^‘A2 





★ 



*^3 

* 

^‘A4 

; I'c “ 

ic 

»^C4 

★ 


★ 

"A5 


H:5 

lAr 


it 

iiAg. 


i!C6 


and “ the mean of the weighted absolute difference between the ground 
truth and regression estimate of crop i (weighted by its ground 
truth pixel proportion) from the USDA procedure 



the mean of the weighted absolute difference between the ground 
truth and regression estimate of crop i (weighted by its ground 
truth pixel proportion) from the CLASSY procedure 


The computed is 20.0823, and Tq Qg(6,32) is 17.4. Since 

> TQ^Qg(6,32), we reject Hq: - |i| = 0 at the 0.05 level of significance 
and conclude that the weighted mean vectors of absolute differences are not the 
same for the two procedures. And the following 


0.446021 


“0“ 

0.026101 


0 

0.88508 

> 

0 

0.281399 


0 

0.169621 


0 

0.149436 


_0_ 


(25) 


indicates again that the CLASSY clustering algorithm seems to perform better 
than the clustering algorithm used in the current USDA procedure. 

4.5 GOMPARISON OF CLASSY AND THE USDA STANDARDIZED PROCEDURE ON AN INDEPENDENT 
TeWseT "" — ■ — ______ 

In this study, the 33 segments were divided into two sets. One set consisting 
of 25 segments is called the training setj the remaining 8 segments form the 
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test set. The 25 training segments were used in training the classifier and In 
obtaining the regression coefficients. The regression line was then applied to 

I 

the eight test segments to determine how well the Tine predicts crop hectarage 
using an Independent set. This study has been completed for both CLASSY and 
the standardized USDA procedure. To compare th| performance of CLASSY and the 
standardized USDA procedure on an Independent test set, a similar Hotelling's 
T^ test as In the previous section has been done on the eight segments. 

The computed T^ Is 11,035, and To,o 5 ( 6 . 7 ) 405.92. With this sample of 8 

segments, since T^ < T§, 05(6 J)» there 1 s not enough statistical evidence to 
reject the hypothesis that the mean vectors of absolute differences between 
ground truth and the regression estimate are the same for the two procedures on 
an Independent test set. A larger Independent test set would be more 
appropriate because the critical value T|(p,N - 1 ) decreases rapidly as the 
sample size N Increases. 

4.6 COMPARISON OF TRAINING AND TEST SET REGRESSION LINES 

In order to determine if the regression line fitted to the 25-segment training 
data was appropriate for the 8 independent test segments, a two-stage F-test, 
as described In section 3.2, was performed. The results are presented In 
table 4-3. Corn and permanent pasture did not pass the homogeneity of variance 
test. The test for equality of regression lines Indicates that the regression 
lines are different only for dense woodland and other hay. However, the fact 
that corn and permanent pasture failed the homogeneity of variance test indi- 
cates that different regresSTon models exist for the training and the test sets 
for these crops. 
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TABLE 4-3.- CLASSY MULTITEMPORAL ANALYSIS; F-TESTS FOR 
HOMOGENEITY OF VARIANCES AND EQUALITY OF REGRESSION LINES 


Crop 

Computed F 
for homogeneity 
of variances 

Computed F 
for equality of 
regression lines 

Corn 

*13.03 


Winter wheat 

1.34 

0.09 

Permanent pasture 

*5.03 


Soybeans 

1.66 

0.10 

Dense woodland 

1.05 

^6.82 

Other hay 

1.01 

^3.61 

Critical values 

.260, 2.51 

3.32 


JHomogeneity of variances rejected. 
^Equality of regression lines rejected. 
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5. EVALUATION OF THE MEAN SQUARE ERROR CLASSIFIER 


5.x BACKGROUND 

The MSE classifier (ref. 7) Is an aTgorithm intended to exploit the Bayes 
classification rule, which assigns an observation x e r"* to one of m 
populations, which the lowest conditional average loss is 

incurred in so assigning x. This conditional average loss for population j is 
given by 

Ujix) » p(u^lx) (26) 

where c^j is the cost incurred in assigning x to uj when it actually belongs in 
and p(w^ i X,) is the posterior probability that x is an observation on w^. 

If a zero cost is assumed for correct classification and equal costs of one for 
incorrect classification, then the optimal classification rule which minimizes 
total expected loss also minimizes the probability of error in classification. 
In this context, the cost function Cjj can be expressed as 

" (1 “ j ) (27) 

where 


and 


itj = 1 if i = j 


p 0 if 1 / 0 


j(x) = (1 - 6^j)p(w^ lx) 


Thus X is assigned to if 


= 1 - p(o)jlx) 


or equivalently, 


w.j(x) < Wj(x) ; j - 1,2, •••,m, j * i 


p(w|[x) > p{o).|x) ; j = l,2,«*»,m, j # i 
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(28) 

(29) 




a»r^ . r i 




The particular algorithm used In this experiment was developed by S, 6. Thadani 
(ref. 7). 

For a given observation x, m loss functions are estimated where* for each j, 
iij{x) is approximated by 

Ij(aj,x) » aj ^(x) (30) 

where 

|(x) * C'|>^(x),**s‘l'p(xl^ 

1s an r-dimenslonal vector whose components are T1 nearly Independent functions 
of X, and 

1s a parameter vector determined so that the following MSE Is minimal; 

The expectation with respect to the overall mixture density function Is denoted 
byETl-}. 

It has been shown (ref. 7) that the vector a^ that minimizes equation (31) Is 
the same vector that minimizes 



where E^{/} denotes the expectation with respect to the conditional probability 
density function p(xlwjj^);^ additionally, If we define 




m 


I 1 ^ A 




(33) 


i S l,...,m 
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then if 


O ’t 

where Is the i^^th training sample from class and |ajr » aj a^, 

< » • i * 1, '‘sr 
A » I , • • • 


(34) 


it can be shown that 


Tim MjiaJ * M?(ai) 

|i|^ w -j *• J 


(35) 


The approach, then, is to minimize M^laj) with respect to a^ and to use a 
reasonably large number of training samples. If represents the number of 
training samples from class i and M * then 

N, 


2j ’ 




-i 


E c. E }()i, ) 
t*l 1 i .=1 ^ X 


(36) 


Where the el- term assures that the sum is positive definite. 


Since equal costs of 1 for misclassification are assumed* this minimizing 
vector can be expressed as 


1&» 

II 

E -t'(Xk)4'^(xJ H 
k*l ^ 


-1 

• 

m 

E 

t=,i 

E ) 
1 ,=r ’ 1 








(37) 


5,2 DESCRIPTION OF PROCEDURE 

The procedure used in testing and evaluating the MSE classifier on the USOA 
data set consisted of the following four tasks: 

a. A determination of the most appropriate form of the classifier. 

b. A simulation, using the MSE classifier, of the standardized USDA procedure 
in which the classifier is trained on all the data for which ground truth 
is available, 

c. A performance evaTuatio?; of the MSE classifier on an independent test set. 
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d. An Investigation of the efficacy of using a cross-validation procedure to 
produce a different regression estimator. 

A detailed discussion of each of the four tasks and the results follows. 

5.3 DETERMINATION* OF THE CLASSIFIER 

This task addressed the Issues of whether pure pixels only should be used In 
training the classifier and whether the terms of either a linear or quadratic 
function should be the components of |(x). Separate computer runs were made In 
which pure pixels and then all pixels were used, respectively, for training. 
Additional runs were made using, first, a linear form of ^(x) and then a 
quadratic form. The conclusion reached was that a classifier trained on all 
the pixels In the crops of Interest and using a quadratic form of the vector 
function ^(x) produced the best classification results. 

Since no clustering Is done In the algorithm, valuable information is probably 

lost in restricting the training Set to pure pixels. In each subsequent task 

> ■ 

described, reference to training the classifier will assume the use of all 
pixels In the training set and the terms of a quadratic function as entries of 
;^(x). 

5.4 SIMULATION OF THE STANDARDIZED USDA PROCEDURE 

In this task, the MSE classifier was trained on the crops of Interest In the 
33 segments and then used to classify all pixels In the 33 segments. For each 
crop, the absolute values of the residuals were compared to the corresponding 
USDA results using a Hotelling's T^ test for multivariate data. This test was 
applied again on the same data with the exception that, for each segment, the 
absolute values of the residuals were weighted by the proportions of the crops 
of interest in that segment. A discussion of the results of both tests 
follows. Following this discussion Is table 5-1. This table reflects the 
statistics collected over the 33 segments. 


5-4 


5.4.1 COMPARISON OF THE MEAN SQUARE ERROR CLASSIFIER AND THE STANDARDIZED USDA 
PROCEDURE 


The Hotellin 9 *s test, as described in section 3.1.2, has been performed to 
compare the results from the MSE classifier with the results from the 
standardized USDA procedure. Stated below are the testing procedure and the 
inferences. 


Let 




^D1 


"02 

"03 

"04 

"05 

"D6 


(38) 


where Mq| is the mean of the absolute difference between the ground truth and 


the regression estimate of crop i from the MSE classifier. 


We test 


Hq: - Pq 


"a - "d 0 

where is defined in section 3.1.2. 


(39) 


Using the ground truth and regression estimates on the 33 segments, the 
computed T^ is 21.777 and T§^ogfC,32) is 17.4. Since T^ > T§,05(6»^2), we 
reject Hq; - Pq - 0 at the 0.05 level of significance and conclude that the 
mean vectors of absolute differences are not the same for the two procedures. 

In this case, however, we have 


a = 


0.52919 

-0.27372 

-1.17319 

-0.34008 

-0.67899 

-4.15128 


(40) 
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Thus, tt cannot be concludecl that one procedure is better than the other 
because the elements in 3 do not have the same sign. 


5.4.2 COMPARISON OF MEAN SQUARE ERROR CLASSIFIER AND STANDARDIZED USDA 
procedure by WF.I6HTED MEAN VECTORS 


Similar testing, as in section 4.4, was done on the mean vectors of weighted 
absolute differences. We test 


Hq- ^*A- d"0 

Hj: 


(41) 


where is 


defined earlier and 


^'d 


is defined in a similar manner as 


* 

^'A* 


The computed T^ is 8.2857 and is 17.4. Since T^ < T§^q5(6,32), 

there is not enough statistical evidence to reject the hypothesis that the 
weighted mean vectors of absolute differences are the same for the two 
procedures. 


TABLE 5-1.- MSE CLASSIFIER MULTITEMPORAL PERFORMANCE MEASURES FOR 
TRAINING AND TESTING ON 33 SECMENTS* 


Crop 

MSE 

A 

% Correct 

Omi ssi on 

Commission 

Corn 

51.90 

0.8460 

65.61 

0.3439 

0.2412 

Winter 

wheat 

24.63 

.3781 

20.13 

.7987 

.4013 

Permanent 

pasture 

361.16 

.7643 

85.34 

.1466 

.5001 

Soybeans 

128.02 

.8478 

83.48 

.1652 

.3573 

Dense 
wood! and 

95.15 

.5733 

33*98 

.6602 

.4765 

Other 

hay 

115*38 

.0005 

1.87 

.9813 

.4706 

I : 


♦Overall % correct = 57.04. 


5-6 





5.5 MEAN SQUARE ERROR CLASSIFIER PERFORMANCE ON AN INDEPENDENT TEST SET 


The MSE classifier was trained on the same 25 segments previously referred to 
as the training set, and all pixels in the 33 segments were classified. The 
regression equation determined by the 25 points obtained in the training 
process was used to predict the ground truth hectares in the 8 test segments. 

A Hotelling's T- test was applied on the mean vectors of absolute differences 
of the ground truth and regression estimates on the 8 test segments. The test 
is now described. 

5.5.1 COMPARISON OF THE MEAN SQUARE ERROR CLASSIFIER AND THE STANDARDIZED USDA 
PROCEDURE ON EIGHT TEST SEGMENTS 

When the performance of the MSE classifier was compared to that of the 
standardized USDA procedure on an independent test set, a Hotelling's T^ test 
on the mean vectors of the absolute differences was conducted on a set of eight 
segments. The computed T^ was 25.1924 and Tq^o 5 ^®>^^ 405.92. Since T^ < 

Tq 05 ( 6 . 7 ), there is, again, not enough evidence to reject the hypothesis. A 
larger independent test set is needed. 

5.5.2 F-TEST FOR EQUALITY OF TRAINING AND TEST REGRESSION LINES 

The two-stage F-test described in section 3.2 was used to determine if the 
regression line fitted through the 25 points using the MSE classifier was 
adequate to predict the ground truth in the 8 test segments. The results are 
presented in table 5-2. Corn and permanent pasture failed the homogeneity of 
variances test. The test for equality of the regression lines was not rejected 
for any crop which passed the homogenei ty of variances test. Following 
table 5-2, table 5-3 displ ays performance statistics compiled on the 25 
training segments and on the 8 test segments. 
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TABLE 5-2.- MSE CLASSIFIER MULTITEMPORAL ANALYSIS; F-TESTS FOR 
HOMOGENEITY OF VARIANCES AND EQUALITY OF REGRESSION LINES 


Crop 

Computed F 
for homogeneity 
of variances 

Computed F 
for equality of 
regression lines 

Corn 

Ml. 896 


Winter wheat 

1.600 

1.240 

Permanent pasture 

*4.009 


Soybeans 

1.939 

1.516 

Dense woodland 

.3979 

1.724 

Other hay 

.6094 

2.332 

Critical values 

.260, 2.51 

3.32 


*Honiogeneity of variances rejected. 
‘Equality of regression lines rejected. 




TABLE 5-3.- MSE CLASSIFIER MULTITEMPORAL PERFORMANCE MEASURES FOR 
TRAINING ON 25 SEGMENTS AND TESTING ON AN INDEPENDENT SET 






' ■ 


1 


5.6 CROSS-VALIDATION PROCEDURE 


The current USDA procedure Is to develop a regression estimator by fitting a 
line to the points obtained from the training data. The objective of the 
fourth and final task was to determine If the estimate of the ground truth 
hectares In the eight test segments could be Improved by using a different 
regression line based on a procedure referred to as cross-validation. Of the 
25 training segments, 1 segment Is left out, and the MSE classifier Is trained 
on the remaining 24 segments. The omitted segment Is then classified as If It 
represented an Independent test set. This process Is repeated for each of the 
25 segments, thus producing 25 points through which a regression line Is 
fitted. The 8 test segments are then classified using the MSE classifier 
developed on all 25 segments, and the ground truth hectares for these 8 
segments are predicted from the regression line. 


Two tests were conducted on the results. The first was the two-stage F-test 
for the equality of the regression line determined In the cross-validation 
procedure and the regression line fitted to the eight test segments. These 
results are presented In table 5-4. It is noted that, in the cross-validation 
procedure, the hypothesis for equality of variances was rejected for woodlands 
in addition to the corn and pasture crops previously rejected in the noncross- 
validation procedure. 

The final question to settle was which of the two procedures, cross-validation 
or noncross-validation, yielded a regression line which best predicted the 
ground truth for an independent set. The Hotelling's T^ test previously 
discussed was used on the eight test segments. In this application, 


H 


0 - ^*1 




'II 


'll 


= 0 


to 


(42) 


where 

Pj = mean vector of absolute differences between the ground truth and the 
regression estimate on an Independent set using cross-validation In 
obtaining the fitted line on the 25 points. 
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jijj « mean vector of absolute differences between the ground truth and the 
regression estimate on an Independent set without cross-validation. 

The computed Is 9.9528 and 405.92. Since 

conclude that there Is not enough evidence to reject the hypothesis. A larger 

Independent test set Is needed. 


TABLE 5-4.- MSE CLASSIFIER MULTITEMPORAL ANALYSIS: 
F-TESTS FOR HOMOGENEITY OF VARIANCES AND EQUALITY 
OF REGRESSION LINES IN CROSS-VALIDATION PROCEDURE 


Crop 

*■"^■>"1 

Computed F 
for homogenel ty 
of variances 

Computed F 
for equality of 
regression lines 

Corn 

*8.478 


Winter wheat 

0.854 

0.412 

Permanent pasture 

*2.980 

1 

Soybeans 

L070 

2.10 

Dense woodland 

*.255 


Other hay 

.553 

1.18 

Critical values 

.260, 2.51 

3.32 


*Homogene1ty of variances rejected. 
tEquallty of regression lines rejected. 

Ino values. 



6. CALIBRATION REGRESSION APPROACH 


6.1 INTRODUCTION 

Statistical methods have often been illustrated with beautiful examples without 
adequately emphasizing the abstract ideas that underlie the methods; that is, 
ideas essential to correct statistical thinking. The result has been that 
certain problems with similar objectives appear amenable to identical 
statistical solutions when, in fact, intrinsic differences exist which alter 
considerably the details of their solutions. It is often the case that the 
practitioner is interested in assessing the value of some quantity which is 
impracticable to assess or impossible to observe directly in a given instancsfi 
the estimation being performed with the aid of a relationship between the 
quantity whose value is sought and another whose value can be determined 
directly. The curve-fitting procedure usually adopted depends on the 
additional assumption that the values of the independent variables are known 
exactly (without error) - an assumption often passed by without emphasis. This 
simplification of problems without explicit mention of the fact fosters 
mi sconGeptions that are carried over into analysis of data, a particularly bad 
misconception being that the variable whose value is to be estimated 
automatically assumes the role of the dependent variable. The calculation and 
use of dosage-response curves to estimate dosage constitute an example. The 
dosage-response curve should be evaluated from a series of observations, with 
dosage as the independent variable, and the curve then used to estimate unknown 
dosages from observable responses. 

To illustrate the aforementioned in more detail, assume that a linear relation 
prevails between U and V 

oq + U + 02 ^ ~ 0 


(431 


which may be written In the equivalent forms 

V * a + 0U 


( 44 ) 


Where 


a s -«q/“2 
li = 

where 


11“ Y + 4V 


(45) 


Y « -aQ/oi 
<S “ 

A common Impression regarding the principles of curve-fitting seems to be: If 

one Is Interested In estimating V from U, then take V » a + bU as the estimate 
of equation (44); if one were fitting by the method of least squares, the a and 
b that minimize E(Vj - V|)*^ would be found. On the other hand, If one Is 
interested In estimating U from V, then U “ c + dV is to be fitted, the values 

A. „ , 

of e and d being chosen so as to make U a good fit In terms of the deviations 

A, 

(Uj - U.). It does not seem to be generally realized that the fitting should 
be done In terms of the deviations which actually represent "error.” Thus, 
when the research worker selects the U-values In advance, holds U to those 
values without error, and then observes the corresponding V-values, the errors 
are 1n the V-values* So, even If the researcher Is Interested In using 
observed values Vq of V to estimate U, he should nevertheless fit V = a + bU 
and then use the inverse of this relation to estimate U; 1.e., U “ (Vq - a)/b. 
Let us examine this from the viewpoint of the theory of least squares. 

Consider the case where the values of U are selected (or adjusted) by the 
research worker, and the corresponding values of V are found by observation, 

One can iiiinimize t(V| - and £(0. •• )^, thereby obtaining the two lines, 

respectively: 

V “ a + bU (46) 

U “ c + dV (47) 



- V|)^ minimized 
ANOVA I 

£{U^ - U^)2 minimized 
ANOVA II 

Total variability of V's about 

Total variability of U's about 

their means E(V^ - 7)^ 

their mean; - 0)^ 

Reduction effected by (46): 

Reduction effected by (47); 

bS(U^ - 0)(V| - 7) 

dt(U^ - 0)(V^ - 7) 

A 

Deviation about V 

Deviation about U 

£(V| - 7)2 - bt(U^ - D)(V^ - 7) 

E(U| - 0)2 - dE(U^ - 0)(V^ - 7) 

*E(V|-f|)2 

= - U^)2 


The AMOVA tables are Interpreted as follows. On the left, E(V| - 7)^ qlves a 
measure of the observed variability of the V-values. The second row of ANOVA I 
gives the portion of the observed variability of the V-values that can be 
attributed to the dependence of V on U, and the last row indicates the mag- 
nitude of the portion of - 7)^ that must be attributed to "error" {this 
portion has been minimized by the fitting process) . In ANOVA II, on the other 
hand, S(U| - 0)^ represents the variability in the chosen values of U which 
resul ted from the way in which the researcher selected them, and it should be 
noted that the corresponding values observed for V have in no way entered into 
their determination. Consequently, the apparent dependence of the U on the V, 
measured by the second row of ANOVA II, is a spurious dependence, and the last 

row of this table cannot be interpreted as being a measure of the "error" in 

the U-values, since it is that portion of the variability of the U-values that 
cannot be accounted for by the variability of the V-values. Briefly stated, 
when the values of U have been selected by the researcher and the corresponding 

O 

V-values observed, the line obtained by minimizing S(U^. - U^) is meaningless; 
and, accordingly, equation (46) is the only correct estimate of the postulated 
linear relationship between U and V. Therefore, if it is desired to reason 

A ■ ■ 

from V to U, this must be done by means of U = (Vq - a)/b. 

One example is to cal ibrate an instrument, say a pressure gauge. Assume that 

the increase in gauge marking is linearly proportional to the increase in 
pressure. To calibrate the gauge, one subjects it to two or more controlled 
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pressures (U) and notes the gauge markings (V). Using these data, the 
parameters are calculated, and the gauge Is calibrated, The gauge Is then used 
to determine unknown pressure (U) simply by reading the marking Vq and 
obtaining U * (Vq - a)/b. 

The calibration problem Is very general. Consider the problem of estimating 
the ground truth crop-type acreage of an area segment from the acreage obtained 
by classifying the Landsat data. To establish the relation between the two 
acreages, a number of segments was selected. The ground truth acreages of 
these segments were recorded and held as constants. The segments were then 
processed by a classification algorithm, and the classification acreages were 
obtained. In view of the fact that the ground truth acreages were controlled 
and the classification acreages depended upon spectral observations which can 
be regarded as chance occurrences and, therefore, are relatively imprecise, it 
seems only appropriate to consider the ground truth as the independent variable 
and classification acreages as the dependent variable. The ground truth 
acreage (U) of a new segment Is then estimated from observing the 

■ A. ■ . . . 

classification acreage (Vg) of that segment by the equation U = (Vg - a)/b. 

More detail on the application of this calibration model to the crop-type 
acreage estimation problem will be given in the next section. 

6.2 DESCRIPTION OF NEW REGRESSION ESTIMATOR 

This section provides a brief description of the regression method currently 
being used by the USDA to estimate the ground truth crop-type acreages. Denote 
the ground truth acreage by U and the acreage obtained from classifying the 
Landsat data by V. Using the sample of 33 segments, U is regressed onto V. 

Ground truth acreages (U^*) and their corresponding classification acreages (V^) 
are obtained for each of the 33 segments. The relation between U and V is then 
assumed to be 

U^. = Y + <SV- + ci ; i = 1,»*«,33 (48) 
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where ej, representing error, is distributed N(0,o'^). Thejeast squares 
estimators d of 5 and c of y obtained by minimizing e{U| » U|)^ are 


£(U| - 0){V| « 7) 

d “ ..... , n .III i l W. 

s(v, - 

(49) 

c * 0 - d? 

(50) 


The regression line is given by U » c + dV, and the ground truth acreage is 
estimated by U * c + dV, 


Although under this model (hereafter referred to as the current model) this 
estimator is unbiased with minimum variance (in the class of all unbiased 
linear estimators), the model does not seem to be appropriate. The reason is 
that, in the current model , the classification acreage (V) was considered as 
the fixed variable and the ground truth acreage (U) as the dependent variable; 
whereas, actually, the values of the ground truth acreages (U) were controlled 
and held as constants and only the values of the classification acreage (V) 
were observed and subject to error. 

The calibration model is now introduced. Regressing the classification acreage 
(V) onto the ground truth acreage (U) gives, 

= ft + 0U| + C| i = 1 , •••,n (51) 

where e,- , representing error, is distributed as N(0,o^). The least square 
estimators a of a and b of 0 obtained by minimizing s(Vj - V^. ) are 


E(U. - 0)(V. - 7) 

b = — J- - ' - -V 

E(U. - 0)^ 
a “ 7 - bO 

The regression 1 ine is 



V =? a + bU 


(54) 


Given a classification acreage V, the ground truth acreage Is estimated by 

( 55 ) 

Another estimator under this model, Ug * c + dV, will also be considered where 
c and d are defined earlier# Note that Ug and U, though having the same form 
c + dV, are two entirely different estimators because they are obtained under 
two different models. For instance, Og is not an unbiased estimator (U is 
unbiased) because the classification acreages (Vs) are no longer considered 
fixed constants under the calibration model . 

We will now restrict our attention to the calibration model , which seems more 
appropriate than the current model in estimating the ground truth crop- type 
acreages. The properties of the two calibration estimators Uj^ and Ug are given 
in the next section. 

6.3 THEORETIGAl PROPERTIES OF THE TWO CALIBRATION ESTIMATORS 
Under the calibration model 

Vj - a + aU^ + ; 1 * 1, •**,n (56) 

where is distributed as N(0,o^), is a maximum likelihood estimator and 
gives a readily interpreted analysis of variance. It may be noted here that 

A 

the mean, variance, and MSE of * (V - a)/b are infinite, since there is a 
nonzero probability that b may be zero. The mean, variance, and MSE of 
Ug = c + dV are finite for n > 4. However, it can be shown, with the help of 
Tchebycheff ' s inequality, that the probability of b lying in an interval that 
contains very small values, i ncl udi ng zero, can be made very small by making 
E(U^ - 0) large, provided I 0 /&I is not large. This can be done by increasing 
n and choosing values of Uj that are not very close to each other. The 
expressions given below should be considered as corresponding to the 
distribution truncated for the value of b very close to zero. 
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Let Uq be the quantity to be estimated and let 


^ g (U, . 0)' 


2 . i^ 

" n 


0 = 1 + 


“TT 


Then, to order i, 
^ n 


in - l)Oy0 

9 r 9 1 9 

/iT \ - n -t 1 3a^ j. a 

Var IU-| ; - “Tjr — n — ■ ^ 

^ r ^ {nTi)^7 (n - Doy 0 ^ 


/M \ - 0^ n + 1 . 3o^ 

^ ^ (n - D oy / 


(n - l)oy^ 


(0 . Uq)- 


(0 - U^)2 


bias (U 2 ) = - 

0 0y6 n0 Oy 0 

/n ) - n + 1 . 0 ^( 0 ^ - 20 + 6) 0 ^ 2a^ ,n 

'^2' " ~ir- ^ —r — ^7 7 TJ- ^ r — , . 2:2 .z ZTJr 

0 0 (n - l)oy0 0 (n-l) 0 y 00 n00(^ 


MSEiUg) 


S n -f 1 . 0 ^( 0 ^ - 20 f 6) 
?? , (n - l)0y0^0^ 


7" '^'°Y 2.2g2 ? 

(n - l) 0 y 0 0 0 0 y 0 no 




From equations (59) and (62), it is evident that both estimators are biased, 
but is asymptotically unbiased whereas Ug is not. 

11m bias (Uj^) * 0 

2 

lim bias (Ug) « (0 - ^ 0 ) (66) 

0 dyO 

However, both biases vanish at the point Uq » Q and may be small when Uq lies 
very close to 0. 


Berkson (ref. 8) has shown that when l<i/Bl is small, the asyn»ptot1c MSE of U. 

A A ^ 

is smaller than Ug except when Uq lies very near to 0. Moreover, is 
consistent whereas Ug is not. Saw (ref. 9) showed that, when Uq lies very 
close to 0, Up is closer than U| to Uq; he further showed that other estimators 
can be obtained that may do even better than Ug in a much smaller Interval. He 
thus found the use of Up to be unappealing on this ground. 

Applying this calibration model to the ground truth, crop-type acreage estima- 
tion problem, and (i were first estimated using the data on the 33 segments. 

n A 

Table 6-1 displays the two calibration estimators \i^ and Ug fv>r each of the six 
crops. Using the estimates of and B and the equations given earlier, bias 
(Uj^), bias (Ug), MSE (Uj^), and MSE (Ug) were calculated for each of the six 
crops, these data are presented in table 6-2. It is clear that the magnitude 

. A. . ' ' A . ■ A ' ' 

of bias (Uj^) is smaller than the magnitude of bias (Ug), and MSE (Uj^) will be 
smaller than MSE (Ug) if Uq, the quantity we wish to estimate, is not very 
close to the sample mean (]. 
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TABLE 6-1.- CALIBRATION ESTIMATORS Uj AND 


Crop 


A 

Ur 


Soybeans 


Corn 

Pennanent 

pasture 

Dense 

woodland 

Winter 

wheat 

Other hay 


. V - 7.2214 
- ~nOPH~ 

_ V - 5.8009 


U, = 


TJ77W 

V - 26.5319 

"■ir:7ei2 — 


•7.5633 + 1.0473V 


- -7.6519 + 1.3191V 


-34.8554 + 1.3137V 


„ V - 4.0353 _ 


U, = 


0.6769 
V - 0.9228 


1 U.46Z1 


U. = 


V - 1.4935 
■ “D"'n77 ■“ 


■5.9614 + 1.4773V 
- -2.0411 + 2.2119V 
s -12.6890 + 8.4962V 


Ug = -1.4261 + 0.8870V 
Ug = -2.8899 + 1.0523V 
Ug = -19.1698 + 1.0386V 
Ug =0.3375 + 0.9211V 
Ug = 1.9412 + 0.8366V 
Uo = 4.8692 + 1.6913V 
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7. CONCLUSIONS AND RECOMMENDATIONS 


7.1 CONCLUSI ONS 

With regard to the standardized USOA procedure used In this study, it seems 
clear that the iiuUi temporal data produce significantly better estimates than 
those obtained using unitemporal data. In addition, it is clear that the cur- 
rent practice of evaluating the classifier and developing the regression on the 
same data set used to train the classifier can lead to optimistic performance 
estimates. With the possible exception of winter wheat and dense woodland, 
both of which had small populations, performance measures calculated using an 
independent test set and similar measures calculated using a cross-validation 
approach were uniformly worse than the same measures calculated on the training 
set. It also seems clear that the regression equation developed on the train- 
ing data may not be appropriate for the test data. All crops tested, except 
winter wheat and dense woodland, showed differences in the regression models 
for lines calculated on a training set and on an independent test set. 

The CLASSY clustering algorithm, when substituted for the current USDA cluster- 
ing method, produced improved estimates. The estimates were significantly 
better than the standardized USDA procedure when testing and training were done 
on all 33 segments. The performance measures for the 33 segments are summarized 
in table 7-1. 

The independent test set of eight segments was not large enough to allow the 
detection of any significant difference between the procedure using CLASSY and 
the standardized USDA procedure; however, the performance measures, as listed 
in table 7-2, indicate an improvement when using CLASSY clustering. 

It is worthwhile to note that this improvement in performance was obtained 
despite the fact that CLASSY requires no decisions from an analyst concerning 
the number of clusters, separability thresholds, or other arbitrary parameters. 
In addition, CLASSY was operating with data for which the outlying observations 
had not been removed. Such observations were removed in the course of 
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COMPARISON OF MULTITEMPORAL PERF0PJ«1ANCE MEASURES FOR 
TRAINIjNG AND TESTING ON 33 SEGMENTS 
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COMPARISON OF MULTITEMPORAL PERFORMANCE MEASURES 
ON AN INDEPENDENT TEST SET 
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executing the standardized procedure. This represents another source of 
subjective analyst Input not needed when using CLASSY. 

The MSE classifier did not produce significantly better hectarage estimates 
than the standardized USDA procedure when evaluated on either the training set 
or the independent test set. However, this classifier showed less sensitivity 
to the training/test degradation discussed earlier. This is evidenced by the 
fact that the hypothesis of equality of regression lines fitted to the training 
and test data sets was accepted for all crops except con and permanent 
pasture, which failed the homogeneity of variances test. Also, the overall 
percent correct on the independent test set decreased least when using the MSE 
classifier. This greater extendibility might be expected due to the fewer 
parameters required to be estimated in using this classifier. 

The calibration approach to regression points out a fundamental problem in the 
current regression model and suggests an alternative which has several 
theoretical advantages. 

7.2 RECOMMENDATIONS 

Several recommendations seem appropriate at the conclusion of this study. 

First, the use of CLASSY clustering in place of the current Editor clustering 
algorithm is recommended. CLASSY seems to offer a tangible improvement to the 
current Editor system in terms of increased performance and decreased analyst 
interaction. 

Also, the study seems to indicate that the regression estimator may be 
improved. Use of a simpler classifier might make regression more extendible, 
and improved performance is expected using the calibration regression 
approach. Unfortunately, this issue is not clearly decided at this time. The 
recommendation is that additional research to improve regression/proportion 
estimation be conducted. This should i ncl ude actual tests of the cal ibration 
approach as well as other alternative approaches. Such approaches include a 
regression model in which both ground truth and classification acreages are 
considered random and the use of di rect proportion estimates. In an 
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operational setting, it is recoinmended that jackknifing be used to obtain more 
realistic performance estimates. 

A final recommendation is that any future work be conducted with a larger data 
set, if possible. The sample size estimates reported in section 2.2 as well as 
our own experience in making the various tests indicate that the sample size of 
the Missouri data set is only marginally sufficient if testing is carried out 
on all the training data. The data set is not sufficiently large to achieve 
significant test results if it is divided into training and test portions. The 
sample size estimates reported in section 2.3 should serve as a guide in 
selecting future data sets and in designing future experiments. 
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APPENDIX A 

CLIPPING LIMITS OF RADIAMGE VALUES 


TABLE A-1.- CORN CLIPPING LIMITS 



Channels 


6 

00 

Min. 

Max. 

Min. 

Max. 


August 

May 


Standardized procedure 


2 



25 I 45 


Multi temporal 12 19 42 72 24 


Independent test set procedure 


69 

*- 

68 



August 

12 

May 

•k- 

Mul ti temporal 

12 



Jackknifing training sets 


Multi temporal 
only 

1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 


,2 19 43 73 

,2 19 43 70 


.2 19 

12 19 


70 23 

70 23 



12 19 42 70 24 44 

12 20 41 73 24 46 

12 21 41 73 23 45 

12 19 41 70 23 45 

12 19 41 71 24 42 

12 19 41 73 24 44 

12 19 41 73 24 44 

12 19 41 70 24 44 



24 62 

24 61 

24 56 

32 61 

24 61 

24 61 

24 61 

24 61 

24 56 

24 61 

24 61 


*For uni temporal data, there are only four channel values 


































TA1LE A-2.- WINTER WHEAT CUPPING LIMITS 


Data 

type 

Channels 

^2 

4 

6 

8 

Min. 

Max. 

Min. 

Max. 

Min. 

Max, 

Min. 

Max. 

StandartHzod procedure 

August 

19 

33 

36 

1 

65 





May 



*- 


15 

30 

52 

82 

Mul ti temporal 

19 

33 

33 

57 

0 

29 

52 

84 

Independent test set procedure 

August 

IR 

32 

34 

56 



'km 


May 

*- 



*- 

14 

30 

56 

83 

Muitl temporal 

19 

32 

34 

56 

14 

30 

59 

83 

Jackknifing training sets 

Mul ti temporal 
only 









1 

15 

36 

30 1 

58 

14 

32 

51 

84 

?. 

18 ; 

32 

34 

58 

14 

29 

52 

80 

3 

18 i 

33 

34 

57 

14 

29 

56 

79 

4 

18 

33 

35 

57 

14 

29 

55 

80 

5 

15 i 

33 

35 

58 

14 

35 

51 

84 

6 

; 

34 

34 

57 

14 

30 

59 

84 

7 

16 i 

33 

34 

58 

16 

31 

64 

78 

a 

17 : 

33 

34 

58 

14 

29 

55 

80 

q 

18 1 

33 

34 

58 

14 

29 

55 

80 

10 

18 

33 

34 

58 

14 

29 

52 

80 

11 

18 

32 

30 

58 

, 

14 

29 

55 

83 


*For uni temporal data, there are only four channel values. 



















TABLE A-3.- PERMANENT PASTURE CUPPING LIMITS 



Channels 

Data 

type 

■2 

4 

6 



Min. 

Max. 

Min. 

Max. 

Min. 

Max. 

Min. 

Max, 

Standardized procedure 

August 

0 

26 

30 

73 


ft. 



May 





16 

35 

45 

103 

Multi temporal 

0 

26 

28 

74 

0 

34 

43 

94 


Independent test 

set procedure 



August 

B 

27 

38 

73 

nj 

B 

■ 


May 

B 

*«, 

** 


14 


41 

88 

Mill ti temporal 

12 

27 

38 

72 

12 

B 

lJL 

87 

Jackknifing training sets 

Multi temporal 
only 

■ 







1 

1 


26 

31 

75 

12 

39 

41 

94 

2 

B 

26 

31 

76 

13 

36 

43 

87 

3 

12 

24 

33 

72 

9 

35 

18 

98 

4 

12 

26 

31 

76 


37 

18 

104 

5 

12 

28 

31 

77 


42 

18 

103 

6 

12 

28 

33 

76 


37 

18 

104 

7 

12 

26 

33 

76 


38 

18 

104 

8 

12 

26 

32 

76 

9 

35 

18 

103 

9 

12 

26 

33 

76 


34 

18 

102 

10 

12 

26 

30 

76 


35 

18 

104 

U 

12 

27 

37 

78 


38 

18 

104 


*For uni temporal data, there are only four channel values. 







































TABLE A-4.- SOYBEANS CLIPPING LIMITS 



Channel s 

Data 

type 

2 

A 


6 

Q 

Min. 

Max. 

Mi n . 

Max, 

Min. 

Max. 

Min. 

Max. 

Standardized procedure 

August 

0 

22 

47 

99 

k^ 

k^ 

k^ 


May 


*- 



23 

48 

31 

65 

Mul t1 temporal 

0 

22 

50 

98 

25 

48 

28 

62 

Independent test set procedure 

August 

12 

21 

48 

1 

105 

k^ 

k,. 

1 

■k. 


May 



k^ 

k^ 

22 

47 

28 

65 

Mul ti temporal 

12 

24 

44 

105 

21 

47 



28 

63 

Jackknifing training sets 

Mul ti temporal 
only 









1 

11 

23 

47 

98 

21 

48 

28 

63 

1 

11 

23 

46 

101 

22 

44 

28 

64 

3 

11 

23 

46 

98 

23 

47 

28 

64 

4 

11 

23 

47 

105 

22 

45 

28 

65 

5 

11 

24 

47 

98 

18 

48 

28 

67 

6 

11 

23 

47 

105 

15 

47 

28 

72 

7 : 

11 

22 

39 

105 

22 

46 

29 

64 

8 

11 

22 

49 

98 

22 

45 

28 

61 

9 

11 

22 

46 

98 

23 

45 

28 

65 

10 

11 

22 

47 

98 

24 

46 

30 

63 

11 

12 

23 

47 

98 

24 

47 

28 

65 


*For uni temporal data, there are only four channel values 
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TABLE A-5.- DENSE WOODLAND CLIPPINCi LIMITS 


Channel s 


6 

1 

g 

! 

Min. 

Max. 

Min. 

Max. 


Standardized procedure 


August 0 23 43 69 
May *- *- 
Mul ti temporal 10 23 44 68 


August 

May 


Independent test set procedure 


8 67 

*_ 


16 27 


MuTtltemporal 10 19 48 70 15 28 


Jackknifing training sets 


Mul ti temporal 


54 

72 

51 

73 


24 

42 

70 

14 

28 

51 

22 

42 

70 

14 

29 

51 

22 

42 

67 

14 

30 

52 

22 

42 

70 

14 

28 

50 

24 

43 

68 

14 

29 

52 

24 

42 

70 

14 

29 

52 

20 

47 

70 

14 

28 

55 

22 

45 

68 

14 

29 

54 

24 

42 

70 

14 

29 

52 

24 

43 

70 

14 

29 

52 

24 

44 

70 

14 

1 

30 

54 


*For umtemporal data, there are only four channel values 








































TABLE A-6.- OTHER HAY CLIPPING LIMITS 


Data 

type 

Channels 

2 

4 

6 

8 

Min. 

Max. 

Min. 

Max. 

Min. 

Max. 

Min. 

Max. 

Standardi zed procedure 

August 

n 

25 

38 

68 





May 

H 




15 

33 

56 

91 

Mul ti temporal 

13 

27 

38 

68 

0 

32 

56 

91 

Independent test set procedure 

August 

13 

28 

37 

68 



***- 


May 

iu 




13 

32 

54 

99 

Mul ti temporal 

13 

26 

38 



69 

12 

32 

49 

100 

Jackknifing training sets 

Mul ti temporal 
only 









1 

11 

28 

37 

68 

12 

32 

52 

92 

2 

11 

27 

37 

68 

12 

32 

50 

100 

3 

13 

27 

33 

75 

12 

32 

50 

90 

4 

12 

28 

38 

68 

12 

32 

50 

100 

5 

11 

28 

37 

69 

14 

32 

50 

93 

6 

11 

29 

37 

75 

12 

32 

50 

|IM 

7 

11 

28 

33 

68 

12 

33 



8 

14 

28 

37 

67 

13 

29 


91 

9 

13 

28 

33 

68 

12 

32 


98 

10 

11 

24 

39 

68 

12 

31 


93 

11 

11 

28 

39 

68 

12 

32 


90 


*For uni temporal data, there are only four channel values. 
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APPENDIX B 

MAP OF MISSOURI WITH SEGf€NT LOCATIOMS 





Approximate locations of 
1- by 1-mile segments 







Gentry County 





Sullivan County 


i 



i 

! 
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TABLE C-l.» NUMBER OF CLUSTERS GENERATED 
TRAINING AND TESTING ON ALL 33 SEGMENTS 


1 

1 

Crop 

JSC* 

Corn 

Z 

Winter 

wheat 

1 

Permanent 

pasture 

5 

Soybeans 

5 

Dense 

woodland 

1 

Other hay 

1 


m BBN. 
^On miac 














APPENDIX 0 

MEAN PURE GROUND TRUTH PIXELS PER SEGMENT 
FOR JACKKNIFED TRAIMIMC AND TEST SETS 
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APPENDIX E 
ARCHIVED FILES 


Listed below are the file naming conventions used In naming files created by 
Editor. 


FRAME. NAMES 
TASK2 


TASKS 

No task number 
CLASSY 


TRAIN 

TEST 

MAY 

AUG 

MTEMP or BILL 

SEGTOT or SGT 

EST or ESP or ESTPAR 

STAT 

ISTAT 

PACK 

CAT 

SCAT 

TBL or TABLE 
CLIPPED 
APRIOR or PUR 


list of Landsat scenes used 


33 segments split Into two groups, 25 for training and 8 
for testing 


jackknifing procedure using Editor 

t'. lining and testing done on all 33 segments 


CLASSY clustering algorithm used Instead of Editor 
clustering 


training set file 
test set file 

file using May acquisition only 
file using August acquisition only 
file using both acquisitions 
segment total file 
estimated parameter file 
statistics file 
inverted statistics file 
automatically packed file 
categorized file 

list of files for scattergramming 
table file 
clipped file 

prior probabilities specified 


E-1 




N-6RPS 

SEGS 

NB 

-NB 

CORN 

PERMANENTPASTURE 
or PASTURE 

DENSEWOQDLAND or 
WOODS 

OTHERHAY or HAY 
WINTERWHEAT or WHEAT 
SOYBEANS 


N clusters 

list of segment numbers 
all pixels available 
border pixels removed 
corn pixels only 

permanent pasture pixels only 

dense woodland pixels only 
other hay pixels only 
winter wheat pixels only 
soybean pixels only 


Examples: 

TASK3/TRAIN/5/PACK. -CORN/CLIPPED Is a packed file of clipped corn pixels used 
as training data in the fifth of 11 jackknifing runs. (There are 30 
segments of corn pixels in this file.) 

BILL/WOODS. SGT 1s the segment total s file for crop dense woodl and using 
mul t1 temporal data when testing and training on all 33 segments. 

TASK2/TEST/CLASSY/CAT. Is the categorized file resulting from classification of 
the 8 test segments after CLASSY was used to cluster the 25 training 
segments. 




<J8C>FRAHE.NAMESf2 

<JBC>TASKZ/TRA1N.SEGS;2 


< JSC >TACK2/ TEST . SECS ? 2 




< JBOMAV/HHEAT . ESTPAR ; 1 
<JSC>MAV/ WHEAT. SEGTOTJ 1 
<JSC>MAY/TAPLE,J4 

< JSOMAY/STAT . -Wl NTERNHEAT/Cl. 1 P ; i 
<JSC>MAY/STAT,15‘-CRPS/CLIP/EP;i 

< JSOHAY/STAT . -OTHERHAY/CL I P J 1 
<JSC>MAY/STAT.-DENEEWaOWLAND/CLIP?l 

< JSOMAY/STAT.-SOVBEANS/CLlPf 1 

< jsomay/stat . -permanentpasture/cli p ; I 

<JSC>MAY/STAT.-C0RN/'CLIPM 

< JGOMAY/SDVBEANS.ESTPAR! i 

< JSOMAY/SOYBEANS . SEGTOT 1 1 

< jsomay/permpagt.estpar; i 

<JSd>MAY/PERf1PAST.5EGT0Tn 

< JSOMAY/PACK . -PERMANENTPASTURE/CL I P J I 

< JSOMAY/PACK .-OTHERHAV/CLlPn 

< JSOMAY/PACK .-OENSEWOODLAND/CLIP J 1 

< JSOMAY/PACK . -SOYBEANS/CLIPM 

< JSOMAY/PACK . -WINTERWHEAT/CL tPf 1 

< JSOMAY/PACK . -CORN/CLI P ; 1 

< JSC:'MAY/PACK.-dTHERHAY/MD7a; 1 

< JSOMAY/PACK. “DENSEWOODLAND/MOTSfl 

< JSOMAY/PAdK .-SdYBEANS/M073; i 

< JSOMAV/PACK .-PERMANENTPASTURE/HP7.3; 1 

< JSC >MAY/PAGK . -W I NTERWHEAT/MC7a ! 1 
< JSC>MAY/PACK .-CdRN/MC73; i 

< JSOMAY/PACK .-NB/MP73 ; } 

< JSO.MAY/PACK . NB/MG7S ? 1 

< JSOMAY/rSTAT.i0"dRPS/PURM 

< JSd>MAY/ISTAT. IS-GRPS/EPU 

< JSOMAY/HAY . ESTPAR 1 

< JSOMAY/HAY . SEDTDT ; 1 
<JSOMAY/DENSEWCODS .ESTPAR M 
<JSOMAY/DENSEWdODS.SEIjTOTVi 

< jsomay/ccrn.estpar; 1 
<JSC>MAY/CORM.SEGrCT;i 
<JSC>MAY/CAT. r t 
<JS,OMAY/TABLE.;3 


E-4 




< JSOAUt'/SQYBEANS . -ESTPARAMETER .* 2 

< JSC > AUG/SO YBEANS * -SEGTOTAL 1 2 

< JSOAUO/SAVTABUE . r 2 
<J6C>AU0/CAT.NB-22GPS/PUEJt 

< JSC >AUG/CAL . PRIOR J I 

< JSOAUG/W interwheat . -^ESTPARAMETER ; 1 
<JSC>AUG/WINTERWHBAT. “SEGTOTAL M 
<JSC>AUG7STAT.“22GPS/EPJ1 

< JSOAUQ/STAT . “OTHERHAY/CLI P 1 1 

< JSOAUO/STAT . “DENSEWOOPLAND/CL I P; I 

< JSOAUQ/STAT. “SOVBEANS/CLrPM 

< JSOAUG/S TAT . “PERMANENTPASTURE/CL I P ;i 

< JSOAUQ/STAT. "WINTERNHEAT/CLIPM 
<JSOAUG/STAT."CaRN/CLlP;i 

< JSOAUQ/SOYBEANS, “ESTPARAMETER M 

< JSOA'Ja/SPVBEANS . -SEGTOTAL ; 1 

< JSOAUG/S AMTASLE. f 1 

< JSOAUQ/PERMPAST . “SEGTOTAL f I 

< JSOAUG/PAGK . “SOYBEANS/CLIP; 1 
<JSOAUQ/PACK.“OTHERHAY/CLIPJ1 

< JSOAUQ/PACK . “DENSEWaODLANP/GLI P f 1 

< jsoAun/p ACK . -fermanentpasture/cl 1 p ; 1 

< JSOAUG/PACK.-W1NTERWHEAT/CLIP; 1 

<JSOAUa/PACK.“CORN/qLIPf 1 - 

<JSO AUG/PACK. “NB/MQ7S;i 

< JSOAUQ/PACK, NB/M07S?! 

< JSOAUQ/OTHERHA Y . “ESTPARAMETER ! 1 
<.JSOAUG/OTHERHAT. “SEQ 1 0TAL ! t 
<JS0AUG/ISTAT,“22QP5/PUR; i 

< J SOAUQ / 1 S TA T . “220PS / EP a 

< JSO AUG/DENSEWD . “ESTPARAMETER ; I 
<JSOAUQ/l)ENSEWD. “SEGTOTAL a 

< JSOAUG/CORN . “ESTPARAMETER J 1 

< JSC >AUG/CORN , -SEGTOTAL ; 1 


<JSC>OIU./MOODS.ESP5t 
<JSC>BILL/WOODS.SaTf I 
<JSC>BILl./HHeAT,ESPJ 1 

< JSOBILl./WHEAT.eOTJ 1 

< JBOBILL/tBL. 12 
<JSd>BILL/SOYOEANS.ESPM 
<JSC>BJdL/SOYBEANB*SGm 

< JSC >B ILL,/ PASTURE * ESP ! i 

<jsc>cill/pasture.sct;i . 

< JSOB I U./ PACK , •‘OTHERHAV/CU PPED ? I 
<JSC>BjU/PACK.-1DENSEWOODLAND/CUPPE0M 

< JSOBILL/PAeK » - soyoeans/clipped; I 

<JSC>B1LL/PACK.-PERMANENTPASTURE/CLIPPEDM 
• BIO 

< JSOB I UL./ PACK . “HI NTERWHEAT/CL I PPEDf 1 
<JSOBlLL/PACK .“CORN/CL I PPEDM 
<JSC>BILL/PACK»“NB/M07S? 1 

< JSOBILL/PACKiNB/MOVS; 1 
<JSC>BILL/ISTAT. ISSRPS/APRigRTZ 
<JSOBIUL/HAY.ESPM 
<JSC>Bll,i/'HAY.SGT;i 
<JSOBll,(-/C0RN,ESPil 
<JSC>BH.L/CORN.SDTf 1 
<JSOI3ILL/CAT. 13 
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< JSL% QLABJIV/WljOUij, r.Ur/PUI?KPrK» 1 

< J8C>f;UAU3Y/WHeAT. KC»T/l»URUfn}{{ 1 

< juoaAsov/tAPue. purepik; i 

<JSC>CLASSV/8Tnr.“HrNT(:f?WHnAT/PUR'E-PlK;i 

< JSOOLAS&Y/STAT . -0TH5RHAT/PUREPIK J t 
<JSC>Cl.ASSV/CTAT.~DEfiSL-WaODL.AW»/PUREPn{Jl 

1 33 

<JSq>CUASSV/STAT.**DPYBEANf5/PURePIX;i 

<JnC>CLASSY/SrAT.--CORN/PUf?EPI>{?l 

<JSC>CEA5SY/STAT.-PAQTURE/rUPEPIXfl 

< JSOCI.ASSY/SOYI3EAN8, R8T/PURr,PI>(; I 

< JSq>CI.Ar»SY/S0VBEAN5 . SGT/PURUPJ K? 1 

< jsq >CLAnS Y/ SOT . -WHEAT/PURSP J X i I 
<JSC>qi.ASSY/SOT.PUREPrX;i 
<JSq>qi.ASSY/PAaTURE,EST/PUREPl}<;i 

< JSOqLASS Y/PASTURE . SOT/PUREP I X J i 
<J8q>qLASSY/ISTAT.-27GRPS/PUREPIX/PRI0RSn 

^833 

< JSOCLASSY/ ISTAT . ~27-GRPS7PUREPIX ; 1 
<JBq>qLASSY/HAY.EST/PUREPUrX;i 
<JSq>qLABSV/HAV.SOT/PUREPrX? 1 

< J sq >qtASS Y/ CORN . EST / PUREP I X .* 1 
<J8C>qi.ASav/CAT.PUREPIK/PRrORS; 1 

< JSq>ELA8SY/l*!00BS . EST J 1 

< JSOnLAGSY/WLJDS . COT ! 1 

< JSOGLAGSY/HHEAT.E0T; 1 

< JSG>qLASSV/WHEAT . SGT } 1 
<JSG>qUASSY/TABLE. • 1 

< JSq>CLASSY/STAT. FIXED ,* j 

< JSC>Gl.AnSY/SOVBEfiKG . EGT .* i 
<JSG>GLASSY/SOYBEANG.S0Tf 1 
<JSC>a. ASSY/ PASTURE. EST? 1 
<4SC>GLASSY/PASTURE.SGT? 1 

< JSOCLASSY/ PACK .NS/ INCL/BORDERPIXELS ? 1 

< JGOCLASSY/ISTAT. PUR? 1 

< JSOCLASSY/HAY , EST ? 1 

< JSOCLASSY/HAY.SaT; I 

< JSOCLASS Y/CORN . EST ? I 
<JSC>CLASSY/CORfv|.SGT?l 

< JSC>CLASSY/qAT,NP/PUR; I 


< JBOTADK2/TRAI N/MAY /W INTERWHEAT , BSP H 

< JSC >TASK2/TRA IN/MAY/ W t NTERWHEAT . SOT ; I 
< JSC>TAaK2/TRAIN/HAV/50VBEANS . BSP n 

< JSC :*TASK2/TRA 1 N/MAV/SOYBEANS . SOT t i 
<J8C>TASK2/TRAlN/«AV/PERMANENTPAarURE.E9P?l 

«0B21 

< JGOTASKE/TRAiN/HAY/PERMANENTPABTURE.SGT; i 
*0021 

< JSOTASH2/TRA 1 N/HAV/ PACK . "QTHERHAY/CU I P M 
621 

< JSOTA5K2/TRAIN/MAY/PACK . •DENSEWOODLANO/CU X P » 1 

20021 

< JSO TASK2/ TRA 1 N /MAY/PACK . -SOVBE ANS/CLl P J 1 
*621 

< JSC >TASK2/TRA I N/MAY/PACK . -PERMANENTPABTURE/CL IP J 1 
» and 20621 

<JSC>TASK2/TRAIN/MAY/PACK.*MINTERWHEAT/CLIPJ1 
* 2082 1 

<JSC>TASK2/TRAlN/MAY/PACK,‘-cqRN/CLiP?l * 
<JSC>TASK2/TRAIN/HAY/PACK.-WINTERWHEAT/M07ari 
» 20821 

< JSOTASK2/TRA1N/HAY/PACK . -NB/M076? I 
<JSC>TASK2/TRA1N/MAY/PACK.NB/MQ7S;1 

< JSOTASK2/TRA1N7MAV/PACK . ~aTHERHAY/H079 12 
»621 

< JSOTASK2/TRA IN/HAY/PACK . -DENSEWOODUANP/H079? 2 
»d 20621 

<JSC>TASK2/TRAlN/MAYyPACK,-SaYBEANS/M078;2 

»B21 

•cj5C>TA3K2/TRATN/HAV/PnCK .•“PBRHANENTPh3TURE/M079»2 
» and 20621 

<JSG>TASK2/TRAlN/HrtV/PACK.-CORN/«079;2 

< J6OTASK2/TRA1N/MAV/0THERHAY, ESP ? 1 
<JSC>TASK2/TRAINyMAY/OTHERHAV.SGTri 
<JSC>tASK2/TRAIN/MAY/DENSEW00DLAND,esp;i 

#1 

<JSC>TASK2/tRAIN/MAV/DENBEW00Di.AND.SGTf 1 

#1 

<JSC>TASK2/TRAlN/MAY/caRN.ESPf 1 
<JSr.>TASK2yTRAlN/MAY/C0RN.SGT;i 
<JSC;>TASK2/JRAIN/H 
< JSC>TASK2yTRAIN/MAVyTBL. J I 

< JSOTASKZ/TRAINyMAY/STAT. 16-GRPS 1 
<JBC>TASK2yTRATNyMAY/ISTAT. IG-ORPS/CEIPM 


1 

1 
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< JSC>tABK2/TEfi1 /HAY/TBL . J I 

< Jce:‘TnsKr/Tt:'iT/HAv/cAT, j i 

< J5C>TA{iKg/TE.aT/«AV/WI»l CRWHGAT.ESPJ 1 
<aSC>TAUK2/TtST/MAV/NI NTERl-JHEAT , SCiT J 1 
<aSC>TAOKgyTEST/MAY/60yiiEANB.ESP) 1 

< af5C>TAeK?,/TfiST/MAY/BOYOKANS*8at! 1 

< JSOTASKg/TCST/HAY/PERMANBNTPASTURK .ESP? I 
*S21 

< JSOTASKg/TCST/MAY/PEimANENTPASTURE .SOT? 1 
♦Oil 

< JSC>TA8Kg/1CST/HAY/PACK . NS/MOTS ! I 

< JSOTASK2/ TCtST/HAY/OTHCRUAV . ESP? I 

< J8C>TASK2/TL‘ST/MAY/0TI!Ef?HAV. SOT? I 

< JSCM'ASKK/rtsSiVMAY/JiENaEWOODLAND . E SP i 1 

< JSOTASK S/ TEST/MA Y/OEM.SEHOODLAND . BGT M 
<aOC1*TASK2/TeST/llAY/GORM.ESPn 

< JSOTASK2/TEST/MAV/CORN . SOT ? 1 
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< J«C>tASK2/Tf(A IN/AIJO/MI NTERWHEAT . ESP ; I 

< JSOTASKS/TRA 1 N/Alifi/N 1 NTLEWIiEAT . SOT J t 

< JSR J TASKS/TRAIN/AUCI/SQVeEANS . ESP J 1 
<J8C>TA6K2/TRAIN/AUQ/S0VCeANS.Sam 
<JSC>TASK2/TRAIN/AUO/l'aRMANENTPAStURE.ESP5 1 

«002l 

< J80TASKZ/ T«A I N/ AUa/PERHANENTPASTURE . SOT J t 

«oazi 

< JSC>TASK2/TRAIN/Aua/PACK.-0THRRHAV/CLIP; I 
wQ21 

<J8C>TASK2/TRAIN/AUG/PACK.*'C0RN/RUIP!t 
<J8C>TASK2/TRAIN/AUa/PACK,-0KNSBW00DEAND/CUPn 
i>d 20521 

< JSC>TASK2/TRA:N/AUG/PACK ."MINTERWHEAT/CLr P f 1 

• 20521 

<JSd>TAGK2/TRAIN/AUa/PACK.-PGRMANKNTPASTURe/CLlPa 
i and 20Q21 

< J SOTASK 2/TRA 1 N/ AUG/ PACK . -SO YBGANS /CL I P f I 
•521 

<JSC>TASK2/TRAIN/AUa/PACK.-QTHERHAy/M07S;i 

•521 

< J80TASK2/TRA1N/AUG/PACK .-DENSEW00DLAND/MO70? I 
•d 20521 

< jsc>tasK2/train/aug/pach .>-soysEANs/M07a; 1 

♦521 

< JSOTASK2/TRAIN/AUG/PACK ,-PERMANENTPASTURE/M079; I 

• and 20521 

< JSOTASK2/TRAIN/AUC/PACK * -WrNTERWHEAT/M079; 1 

• 20021 

<JSC>TASK2/TRAJN/AUG/PACK*-C0RN/M079ri 

< JSOTASK2/TRA I N/AUO/PACK . -NB/M07a 1 1 
< JBC>TASK2/TRAtN/AUQ/PACK , NB/M070 M 
<JSC>TASK2/TRArN/AUG/0THERHAY.ESPM 
<JSC>TASK2/TRAlN/AUG/afHERHAy.S0TM 

< dSC>TASK2/tRAiN/AUG/DENSEH00DLANB .ESP I* 1 
♦ 1 

< JSOTASK2/TRAIN/AUG/DENSEWOODLAND . sot; 1 

• 1 

< JSC>TASK2/TRAIN/AUQ/C0RN .ESPI 1 

< JSOTASK2/TRAIN/AUQ/CORN. SGT 1 1 
< JSC>TASK2/TRAIN/Aua/TBL. ; 1 

< JGOTA5K2/TRAIN/AUG/STAT. IG-GRPB? I 
<JSC>TASK2/TRAIN/AUd/ISTAT. IG-CRPS/CLrp; 1 

< JBOTASK2/TRA1N/AUG/CAT. ; 1 • 
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<JSC>TAGhi?/TCGT/AUa/HlNTnRHHtiAT.BQT}l 

< JSUMAEKS/TEIiT/AUO/MINTnRWHFAT. ESP 1 2 

< JSC>TASK2/TEnT/AUG/80 .'CEANS . ESP J t 

< JSC:>TA5K2/TrST/AUfi/S0VCEANB , SOT U 
<JSC>TA5K2/TEGT/AUQ/PRWIANENTPASTUrvB.CSPM 

»02l 

<JSC>TASK2/TESr/AUQ/PERMANENTPA8TURE.SaT;i 

»D21 

<aOS>TA6K2/TEST/AUQ/PACK . NB/H070 I 

<J{3C>TAGK2/TEST/AUG/OTHERHAY.ESPn 

<JGC;tASK2/TC&T/AUG/OTH£RIIAY.SCiTI1 

<JSC>TAGK2/TEST/Aun/DEMSCW00DEAND.ESPM 

< JSC>TASK2/TrST/AUG/DENS£M00DLANS . SGT ? I 

<JRC>TAGK2/TCST/AUG/CrjRN,CSPM 

< JSC >TASK2/Tb'riT/AUG/G0RN . SGT M 

< JSCJ'T ASK2/rcST/Ayu/ CAT . 1 1 
<JSC>TASK2/TEST/AUQ/TEl.. M 
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< JSOTASK2/TRAIN/MTEMP/TBL1 . ; 1 . 

<JSC>TASK2/Tf<AIN/MtEMP/BTAT.lB“GRP»;i 
<JSC>TASK2/TRAlN/MTEMP/ISTAT.lB-C«PS/CLrP;i 

#nn?7 

<JBC>TABK2/TRA1N/MTEMP/CAT. ; 1 
<JSC>TASK2/T(?AIN/MTEMP/WINTERWHEAT.ESP;1 

#1 

< J80TASK2/TRA I N/MTEMP/MINTERWHEAT . SCT ; I 

*1 

<JBC>TABK2/TRAIN/l1TEMP/B0VBGANS.ESP;i 
<JSC>TASK2/TRArN/MTEHP/S0V0EANS.SGT;i . 

< JSOTASK2/TRA rN/MTEHP/PERMANENTPASTURE . ESPM 
* 20021 

<JSC>TASK 2 /TRAIN/MTEHP/PERMANENTPASTURE.SQTn 
* 20021 

< JSd>TASK2/TRArN/HTEMP/PACK .-OTHERHAY/CLIP; 1 
•#20821 

<JSC>TASK2/TRA1N/MTEMP/PACK.-DENSEW00DLAND/CLXPI1 
■#aivd 20021 

< JBC>TASK2/TRAlM/MTEhP/PACK . -SOVBEANS/CL I P J J. 

*20021 

< JSOTASK2/.TRA I N AHTEHP/ PARK . -PERMANENTPASTURE/CLIP ; 1 
#9 and 20821 

< JSOTASK2/TRAIN/MTEHP/PACK .-WINTERWHEAT/CLIP; 1 

■»d 20021 

<JSC>TASK2/TRAIN/MTEHP/PACK. -corn/clip; I - 

#1 

< JSC >TASK 2/ TRA IN / HTEMP /PACK . -OTHERHA V/M079 1 1 
*20821 

<JSC-‘?TASK2/TRArN/MTBMP/PACK.-DENSEW00DLAND/MO79M 
«and 20821 

<JSC>TASK2/TRAIN/MTEMP/PACK.“S0YeEANS/M079;i 

#20021 

< JSOTASK2/TRA IN/NTEHP/ PACK . -PERMANENTPASTURE/M07S ! 1 
*9 and 20821 

<JSC>TASK2/TRAIN/HTEMP/PACK.-MINTERWHEAT/M079;i 
♦d 20821 

<JSC>TASK2/TRAIN/HTEMP/PACK.-C0RN/M079M 

*1 

<jSC>TASK2/TRAIN/f1TEMP/PACK.-NB/M079;i 

<JSC>TASK2/rRAIN/HTEMP/PACK.NB/M079ll 

<JSC>TASK2/TRAIN/MTEMP/0THERHAV.ESP?1 

<jsc>task2/train/mtemp/otherhay.sgt;i 

< JSC>TASK2/TRAIN/MTEMP/I)ENSEW00DLAND.ESPM 
*921 

<JSC>TASK2/TRA1N/MTEMP/I)ENSEWGJDLAND.SGTM 

*821 

<JSC>TASK2/TRAIN/MTEMP/C0RN.ESP;i 

<JSOTASK2/TRAIN/MTEMP/CORN.SGT;1 


< JSOTASK2/TEST/MTEHP/TBU. ;2 " 

< jbotasks/'TEst/mtehp/'cat. ; 1 
<JSC>TASK?./TEST/MTEMP/WINTERWHEAT.ESP71 
<JSC>TASK2/TEST/f'ITEMP/WlNTERWHEAT.SQT; 1 
<JSC>TASf<2/TEST/MTEMP/S0VBEANS.ESPM 
<JSC>TASK2/TEST/MTEMP/S0YBEANS.S0T; J 
<JSC>TASK2/TEST/MTEI1P/PERMANENTPASTURE.ESPM 

« 2002 l 

< JSOTASK 2/ TEST/MTEMP/PERMANENTPASTURE . SOT ; 1 
*20021 

< JSOTASK2/TEST/MTEMP/PACK .NB/f1079; 1 

< JSOTASK2/TEST/MTEMP/OTHERHAV.ESP; 1 

< JGOTASKZ/TEST/MTEMP/OTHERHAV . SGT ; 1 
<JSC>TASK2/TEST/MTEMP/DENSEW00DLAND.ESP;i 

*21 

< JSOTASK2/TEST/MTEI1P/DENSEW00DLAND . SOT ; 1 
*21 

< JSOTASK2/TEST/HTEI1P/C0RN.SGT; 1 
< JSC>TASK2/TESr/MTEMP/C0RN.ESP; 1 



< JSC>TflSK2TEST/CLASSY/S0yBEANS , EST; I 
<JSC>TASK2/TRAIN/CLASSY/W00 DS.ESt; 1 

< JSOTA5K2/TRAIN/CLASSY/WOODS . SOTI 1 

< JSOTABK2/TRAIN/CI.ASS Y/WHEAT . SGT J 1 

< JSOTASK2/TRAIN/CLASSY/WHEAT.EST; 1 

< JSOTAGK2/TRA1N/CLASSY/SOYOEANS. EST; » 

< J80TABK2/TRA tN/CLASBY/SOYBEANS , slJGTn 
<JSC>TASKZ/TRAlN/CLASSY/PASTURE.ESm 

< JSOTASK2/TRA I N/CLASSY/PASTUf?E . SGTI 1 

< JSOTASKZ/TRArN/CLABSY/HAY . EGT ; 1 
<JSC>TASK2/TRAIN/CLASSYyHAY.SaTf 1 
<JSC>TASK2/TRAIN/CLAGBY/C0RN.ESTJ1 

< JSOTASKZ/TRA IN/CLASGY/CORN . SGT } 1 
<JSC>TASK2/TRAIN/CLASSV/CAT. M 
<JSC>TA5KZ/TEST/CLASSY/W00DS.ESm 

< JSC >TASK2/TEST/CLASSY/WOODS. SGT J t 
<JSC>TASK2/TEST/CLASSY/WHEAT.E3m 
<JSC>TASK2/TEST/CLASSY/WHEAT.BGTa 
<JSC>TABKZ/TEST/CUASSV/SOVBEANSrSQTf 1 

< JSOTASK2/TEST/CLABSY/PASTURE . EST ! 1 

< JSOTASK2/TEST/CLASSY/PASTURE rSGTM 

< JSC>TASK2/TEST/CLASSY/HAY.EST‘ 1 * 

< JSC>TASK2/TeSt/CLASSY/HAY.SGT; 1 

< JSOTASK2/TEST/CLASSY/CORN.ESTJ 1 

< JSOTASKZ/TEST/CLASSY/CORN . SGT ! 1 

< JSC>TASK2/TEST/CLASSY/C.n. ? 1 

< JSC>Cl.ASSY/TRArN/TABLE. M 

< JSOCLASSY/TEST/TABLE. r 1 

<JSC>TASK2/TRA1N/CLASSY/ISTAT.-24GRPS/PUR;1 

»0B53 

<JSC>TASK2/TRAIN/CLASSY/ISTAT.-24GRPS/Ep;1 

< JSOTASK2/TRAIN/CLASSY.BOUTM 

< jsc>task2/test/cl,assy.bout; 1 

<JSC>TASK2/CLASSY/STAT. -other; 1 
<JSC>TASK2/CLASSY/STAT. -PERMANENT M 
<JSC>TASK2/CLASSY/STAT. -soybeans; 1 
<JSC>TASK2/CLASSy/STAT .-SOYBEANS ;2 
< JSC>TASK2/CLASSY/STAT.-C0RN; 1 
<JSC>TASK2 /CLASSY/STAT. -winter;! 
<JSC>TASK2/CLASSY/STAT. -dense; ! 



< J so T ASK 3 / TR A I N / 1 . SE08 ? 4 


< JSOTASK3/TRA I N/ 1 /PACK . -OTHERHAV/CLI P ; 1 

< JSOTASK3/TRA IN/ 1 /PACK , -DENSEWaODLAND/CL I P f i 
« 20S27 

< JSC >TASK3/TRA I N/ 1 /PACK , -PERMANENTPASTURe/CL I P J 1 
*nd 20027 

<JSOTASK3/TRAXN/l/PACK.-SOyBEANS/CLIPM 

#7 

<J5C>TASK3/TRAlN/i/PACK.-MINTERWHEAT/CLIP;i 

K’0027 

< JSOTASK3/TRA IN/ 1 /PACK . -CORN/Cl, I P i I 

< JSOTASK3/TRAIN/1 / PACK . ^0THERHAY/M073r 1 
*7 

< JSOTASK3/TRAIN/ 1 /PACK . -DENSEWO0l)LAND/MO79J 1 
« 20B27 

<JSC>TASK3/TRAIN/l/PAeK.*-S0YBEANS/M079;i 

*7 

< JSC>TASK3/TRAlN/17PACK.-PERMANENTPASTURE/«q79?l 
#nd 20027 

< JSC >TASK3/TRA I N/ 1 /PACK . -WI NTERWHEAT/f1079 J 1 
*0827 

<JSC>TASK3/TRAIN/1/PACK.“C0RN/M079M 

< JSOTASK3 /TRA I N/ 1 /PACK . -NB/f1d79 f I 

< JSOTASK3/TRA IN/1 /PACK. NB/H079 12 


< JSOTASK3/TRA1N/ 1 /W INTERWHEAT. ESP ; 1 

< JSOTASK3/TRA IN/ 1 /W I NTERWHEAT . SGT 7 1 
< JSOTASK3/TRAIN/1/TB.U.M ‘ ‘ 

< JSOTASK3/TRAIN/1/STAT. IG-GRPSf 1 
<JSC>TASK3/TRAlN/l/STAT*--0THERHAY/GUrp;i 
•7 

< JSOTASK3/TRA I N/ 1 /STAT . -DENSEWOODLAND/CL I P ; 1 
* Z0B27 

< JSOTASK3/TRAIN/1 /STAT. -SOYBEANS/CLIP ;i 
’#7 

<jsc>task3/train/i/btat.-permanentpasture/clip;i 
•# nd 20027 

<JSC.HTASK3/TRAIN/1/STAT.-W1NTERWHEAT/CLIP;1 

•#0827 

< J sc >TASK 3 /TRA I N / 1 / STAT . “CORN/CL 1 P J I 
<JSOTASK3/TRAlN/l/SOYeEANS.ESf-,’l 

< J50TASK3/TRAIN/ 1 /SOYBEANS. SGTM 

< J SOTASK3 /TR A I N / 1 /PERMANENT PASTURE . ESP f 1 
•#27 

<JSC>TASK3/TRAIN/l /PERKANENTPASTURE. SGT f 1 
•#77 

<JSOTASK3/TRAIN/) /OTHERHAY.ESPfl 

< JSOTASK3/TRAIN/1/QTHERHAY.SGT; 1 
<JSC>TASK3/TRAIN/1/ISTAT. 1 6-GRPS/CLI P J 1 
<JSC>TASK3/TRAIN/1/ISTAT. 16-GRPS; 1 
<JSOTASK3/TRAlN/l/DENSEWODDLAND.ESP;i 

< JSOTASK3/TRAIN/1/DENSEWOODLAND.SGT; 1 
<JSOTASK3/TRAIN/l/CORN.ESP;i ' 

< jsc>tabk3/train/i/Corn.bgt;i 

< JSOTA3K3/TRAIN/1/CAT. J 1 
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<JSC>TASK3/TEST/l/MINTERWHEAT.SaTf i 

< JSC >TASK3/TEST/ 1 /W INTERWHEAT . ESP 1 1 

< JSOTASK3/TEST/1/TBL. M 

< JSC >TASK 3V TEST/ 1 /SOYBESNS . ESP! 1 

< JSOTASKS/TeST/ 1 /SOYBEANS . SOT f I 

< JSOTASK3/TEST/ 1 /PERMANENTPAStURE. ESP 1 1 
*7 

< JSOTASK3/TEST/ 1 /PERMANENTPASTURE. sot; 1 
7 

< JSOTASK3/TEST/T /PACK .NB/H079 ! I 

< JSOTASK3/TEST/ 1 VOTHERHAY.ESP r 1 

< JSOTASK 3 / TEST/ J /OTHERHA Y . SOT ! 1 

< JSC >TASK3/TEST/ 1 /DENSEWOODLAND . ESP ; 1 

< JSOTASK3/TEST/1/DENSEWOODLAND. SOT; 1 

<jsc>task3/test/i/corn.esp;i 

< JSOTASK3/TEST/ 1 /CORN .saT;i 

< J SC >TASK 3 /TEST/ 1 /CAT . M 
<JSC>TASK3/TEST/1.SECS;2 




<JS£’>rASK3/Tf?AIN/2.0EaSf2 

<4eC>rASK3/TRAIN/S/WINTERWHBAT.ESPJl 
<4SC>TASK3/T1?A1N/2/WINTERWHEAT.SQT;i 
< 4SC>TASK3/TRAJN/2/tBL. ?1 

< J80TASK3/TRA IN/2/STAT, IG-ORPS 5 1 
<JSC>TASK3/TRAIN/2/srAT.-0THERHAY/CLIP,*l 

S3 

<JSC>TA8K3/TRAIN/2/STAT.-DENSEMa0DLAN0/CLIP;i 
» 20033 

<JSC>TA8Ka/TRAIN/2/STAT.~S0VBEANS/CLIPM 

»3 

<J8C>TASK3/TRAIN/2/STAT.~PERMANENTPASTURE/CLIPM 
«Hi4 20033 

<JSC>TASK3/TRAlN/2/STAT.-WINTERWHEAT/CLIPM 

»0B33 

< J30TA8K3/TRA I N/2/STAT . -CDRN/CL I P J I 
<JSC>TASK3/TRAIN/2/S0YBEANS.ESP?l 

< jsc>TA0Ka/TRAiN/2/aoyBEANS. sgt; 1 

<JSC>TABK3/TRAIN/2/PERMANENTPASTURE.ESP?l 

<■33 

< JSOTA3K3/TRAI N/2/PERMANENTPASTURE . SGT ; I 
»33 

<JSd>TASK3/TRAIN/2/PACK.-SQYBEANS/CLlP; 1 
»3 

<JSC>rA0K3/TRAIN/2/PACK.-OTHERHAY/CLip; I 
#3 

< JSC>TASK3/TRArN/2/PACK .“DENSEWOODLAND/CLIP ; 1 

# 20033 

<JGQ>TASK3/TRAXN/2/PACK.-PERMANENTPASTURE/GL1P;1 

20033 

<jr>C>TASK3/TRAXN/2/PACK.-WINTERWHEAT/CLIP;i 

#0033 

< JSOTASK3/TRAXN/2/PACK . "CORN/CLiP; 1 

< JSOTA3K3/TRA IN/2/ PACK . "OTHERHAY/MO70 ; 1 
*3 

<JSC>TASK3/TRAIN/2/PACK.-DENSEM00DLAND/H079M 

* 20833 

< JSOTA0K3/TRAIN/2/PACK .-S0YBEANS/M079; 1 

#3 

<JSC>TASK3/TRA IN/2/ PACK. -PERMANENTPASTURE/M079M 
#nd 20033 

<JSC>TASK3/TRAIN/2/PACK.-WINTERWHEAT/ti079; 1 
♦0033 

< JSOTASK3/TRAXN/2/PACK .-C0RN/M079; 1 

< JSOTASK3/TRAIN/2/PACK . -NB/M0*'9; I 

< JSOTASK3/TRAXN/2/PACK .NB/M079; 1 

< JSOTASK3/TRAIN/2/OTHERHAV.ESP?! 
<JSC>TASK3/TRAXN/2/0THERHAV.SGT?l 

< JSC>TASK3/TRArN/2/ISTAT. 1B-GRPS/CLXP;1 
<JSC>TASK3/TRAXN/Z/ISSTAT. lG-CRPS;i 
<JSC>TA3K3/TRAIN/2/DENSEW0QDLAND.ESP; t 
<JSC>TASK3/tRAIN/2/DENSEWOODLAND.0GT;i 

< JSOTASK3/TRA IN/2/C0RN. ESP ; 1 . 

< JSOTASK3/TRAXN/2/C0RN.SGT; 1 
<JSC>TASK3/TRAIN/2/CAT. ri 

< JSOTASK3/TRAIN/2. SCAT-FILES ;i 
<JSC>TASK3/tRAIN/2.SEGS;X 


<JSC>TASK3/TEST/Z/WINTERHHEAT.ESP;1 

<JSC>TASKa/TEST/2/WlNTERWHEAT,SQTM 

< JSOTASK3/TEST/2/TBL. ; 1 
<JSC>TASK3/TEST/2/S0YBEANS.ESPU 
<JSC>TASK3/TEST/2/S0YBEANS.saT!i i 
<JSC>TASK3/TEST/2/PEBMANENTPASTURE.ESPM 

«#3 

< J SO TASK 3 / TEST/ 2 / PERM ANENTPAS TURE . SOT » I 

#*3 

<JSC;*TAaK3/TEST/2/PACK.NB/M07S;i 

< JSd>TASK3/TEST/2/PTHERHAY,ESP; I 
<JSOTASK3/TEST/2/OTHERHAY.ESP.;2 

< JSOTASK3/TEST/2/OTHERHAY.SGT; I 


<JSOTASK3/TEST/2/DENSEWOOOLAND.SOT;1 
'<-JSOTASK3/TEST/-2/CORN.ESPM * 

< JSOTASK3/TEST/2/CORN . SUT? 1 

< JSOTASK3/TEST/Z/CAT. ; 1 
<JSOTASK3/TEST/2.SCAT-FILES;i 
<JSOTASK3/TEST/2.SEGS?2 ‘ 


< JSOTASKa/TRA IN/3/W I NTERWHEAT . ESP T I 

< JSOTASK3/TRA rN/3/WINTERWHEAT . SGT ! 1 
<4SC>TASK3/TRAIN/a/TBL. U 
<JSC>TASK3/TRAIN/3/STAT.lG-0RP8U 

< JSOTASK3/TRA IN/^3/STAT . -dTHERHAV/CLI P ; i 

»3 

<JSC>TA6K3/TRAIN/3/STAT.“DEN8BW00D(,AND/CLIPM 
» 20333 

<JSC>TASK3/TRAIN/3/STAT**-S0VBEANS/CLiP;i 

*3 

<JSC>TASK3/TRArN/3/0TAT^^PERHANENTPAStURE/CLIPJl 
»nd 20S33 

<JSC;*rASK3/TRAIN/3/STAT.-HINTERWHEAT/'Cl.IPn 

»O033 

< JSC >TASK3/TRAIN/3/STAT . -CORN/CLJ P ! 1 

< JSC>TASK3/TRAIN/3/vS0ySSANS . ESPM 
<JSC>TASK3/TRA1 N/3/SGy6EANS . SGT M 

< JSOTASK3/TRAIN/3/PERMANENTPASTURE , ESP ; 1 
*33 

<JSC>TASK3/TRAlN/3/PERHANENrPASTURE.SGTn 

#33 

CJSOTASKS/TRAlN/a/PACK.-OTHERHAY/CUPOM 

#33 

<JSC>TASK3/TRArN/3/PACK.^DENSEMaODLAND/CLIPU 

* 20033 

< JSOTASK3/TRA1N/3/PACK .-SOVSEANS/CLIP; I 
#3 

< JSOTASK3/TRA IN/S/PACK * “PERHANENTPASTURE/CL r PD; i 
•and 20333 

< JSOTASK3/TRAIN/3/PACK .-WINTERWHEAT/CLIP; 1 
♦0333 

< JSOTASK3/TRA1N/3/PACK . ~C0RN/CUP i 1 

< JSOTASKO/TRAIN/3/PAGK . -OTHERHAy/M07S ; 1 
#3 

<JSC>TASK3yTRAlN/3/PACK.-DENSEW00DLAND/MD73;i 

* 20833 

<JSC>TASK3/TRAlN/3/PACK.-S0YBEANS/ri079M 

* 3 

<JSC>TASK3/TRAIN/37PACK.-PERMANENTPASTURE/M079;1 
#nd 20833 

< JSOTASK3/TRA1N/3/PACK . -WINTERWHEAT/M079 ; 1 
♦0833 

< JSOTASK3/TRA1N/3/FACK . •CaRN/M079M 
<JSC>TASK3/TRAIN/3/PACK.-NB7M079;i 

< JSOTASK3/TRAIN/3/PACK . NB/M079M 
<JSC>TASK3/TRAIN/3/0THERHAY.ESPM 
<oSC>TASK3/TRAlN/3yOTHERHAY.SGTU 

< JSOTASK3/TRAIN/3/ISTAT, IB-GRPS/CLIP; 1 

< JSOTASK3/TRAIN/3/ISTAT. IG-GRPS; 1 
<JSC>TASK3/TRAIN/3/DENSEH0dDLAND.ESP;i 
<JSC>TASK3/TRAIN/3/DENSEW00DL.AND.SQTf 1 

<jsc>task3/train/3/corn.esp;i 

< JSCMASK3/TRA1N/3/C0RN*SGT; 1 

< JSOTASK3/TRAIN/3/CAT.M 
<JSC>TASK3/TRAIN/3. SCAT-FILES M 
<JSC>TASK3/TRAJN/3.SECS;2 
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<JBC>TASK0/Te6T/3/MINTE(?WHErtT,E6P;i 

<JSC>rA£fK3/TEST/3/WINTERHHEAT,S£JTM 

< JSOTAGK3/TEST/3/TBI,. J I 
<J3C>TA8K3/TEST/3/CqVBEANS.ESPfi 

< JSC>TASK3/TEST/3/S0V0EANS.3Cm 
<JSC>TASK3/TEST/3/PERHANENTPASTURE.ESP;I 

#3 

<JSC>TASK3/TEST/3/PERMANENTPASTURE.S0m 

*1 

< JSOTASK3/TEST/3/PACK /NB/M073M 
<JSC>TASK3/TEST/3/0THERHAy.ESPJl 
<JSC>TASK3/TEST/3/DTHERHAV.SGTM 

< JSC>TASK3/TEST/3/DEN6EN0dDLAND.ESPn 
< JSC>TASK3/TESr/3/DENSEWOOOLAND. SOTM 
^JSOTASKa/TEST/S/CORNjESPn 

< 4SOTASK3/TBST/3/ SBT ! I 
<4SC>TA8K37TEBT/3/CATr. ;i 
<JSC>TASK3/TEST/3.SCAr^FILESfl 

< JSC>TASK3y TEST/3, sees; 2 . 


1 




<JS0>TABK3/TRflIN/4/WINTEnWH»SAT.ESPJ 1 
<JBC>TA0K3/TRAlN/4/WlNTERNHeAT.SQm 
<4SC>TASK3/TRAIN/4/TBL. ; 1 
<JSC>TASK3/TRArN/4/STAT. 16“0RPS; i 
<JSC>TASK3/TRAlN/4/STAT.-0THERHAy/CLlP71 

<JSC>TASK3/TRAIN/4/STAT.-DENSEW00DLAND/CL1PJI 

* 20042 

<JSC>TASK3/TRAIN/4/STAT.-S0YBEAN8/CLIP;i 

*2 

<JSd>TASK3/TRAIN/4/STAT.-PERMANENTPASTURE/CLIPM 
»nd 20S42 

<JSC>TASK3/TRAIN/4/STAT.-WINTERMHEAT/CUP?J 

»0B42 

< JSC>TASK3/TRArN/4/STAT.“C0RN/CLip; 1 
< JGC>TASK3/TRArN/4/SQVBeANS i ESP ; 1 

< JSC>TASK3/TRAIN/4/SaYBEANS .SCiTJ 1 

< JSOTASK3/TRAIN/4/PERMANENTPASTURE. ESPf 1 
♦42 

<JSC>TASK3/TRArN/4/PERMANENTPASTURE.SQTM 

t42 

<JSD>TASK3/TRAIN/4/PACK.-0THERHAY/CLIP;1 

’^2, 

<JSC>TASK3/TRAIN/4/PACK.-DENSEW00DLAND/CLIPM 

# 20B42 

<JSC>TASK3/TRAIN/4/PACK.-PERriANENTPASTURE/CLIP;i 
#nd 20842 • 

<JSd>TASK3/TRAIN/4/PACK.-WINTERWHEAT/CUP;i 
«OB42 

< JSC>TASK3/TRArN/4/PACK . ~S0YBEANS/dL I P ; 1 
•»2 

<JSG>TASK3/TRAIN/4/PACK.“G0RN/CUIPM 
< JSd>TASK3/TRAIN/4/PAdK .-0THERHAy/M079; 1 
•2 ■ 

<JSC>TASK3/TRAINy4/PAdK.-DENSEWOODLAND/M079JI 
t 20842 

<JSd>TASK3/TRAIN/4/PAGK.-S0VBEANS/M079;i 

*2 

< Jt'C>TASK3/TRAIN/4/PAdK .-PERMANENTPASTURE/H079; 1 
*nd 20042 

<JSd>TASK3/TRAlN/4/PACK.~WlNTERWHEAT/M079;i 

*0042 

<JSC>TASK3/TRAIN/4/PAdK,-G0RN/MD79;i 

< JSOTASK3/TRAIN/4/PAGK . -NB/MD79 i 1 
<JSd>TASK3/TRAIN/4/PAGK.NB/M079M 
<JSG>TASK3/TRAIM/4/0THERHAY.ESP;1 
<JSd>TASK3/TRAIM/4/0THERHAy.SCTf 1 

< JSD>TASK3/TRAlN/4/iSTAT. IG-GRPS/GL I P r 1 
<jSd>TASK3/TRAJN/4/rSTAT. 16-RRPSM 
<JSC>TASK3/TRAlN/4/DENSEW00DLAND.ESP ? 1 
<JSd>TASK3/TRArN/4/DENSEW00DLAND.SGTM 

< JSC>TASK3/TRArN/4/C0RN.ESP; 1 
<JBd>TASK3/TRArN/4/G0RN.SGm 
< JSd>TASK3/TRAIN/4/dAT. r 1 
<JSC>TASK3/TRAIN/4.SGAT-FILESM 
< JSG>TASKS/TRA1 N/4 . SEGS ; 2 
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< JSe^TASK3/TBf5T/4/WlNTKf?WHEAT.EGPf 1 
<J6C>rASK3/TGfJT/4/l«IINTEf?WHErtT.SPrft 
<JSC>TASK3/TCGr/'>J/TBl., ? I 

< JSC>TASK3/Tr:GT/4/eOYBEANS.ESPn 

< JSC>TAnK3/TE9T/ 4/SP VBEANS . riCiT 5 1 

< JBC>TAPK3/Tf- ST/4yPCttHANENTPASTURE . ESP M 
♦2 

<JSC>TASK3/TEST/4/PERMflNENTPASTimE.SBTri 

f2 

<4SC>TASK3/TEST/4/PAGK . NB/rt073 f I 

< JSC>TASK3/TCBT/4/PTHCRHAy .EBPM 
<JSC>rASK3/TEST/4/0THERHAY.SPT; I 
<J8P>TASK3/TEST/4/PENSEWPO0LAND.SGT ? i 
<JBC>mSK3/TEST/4/C0RN,ESP; 1 
<JSC>TASK3/TEST/4/CQRN,SPT?1 
<dSd>TASK3/TEST/4/CAT . f 1 
■CaSC>TASK3/TEST/4 . SCAT-PILEB; 1 
<JSa>TA0K3/TEST/4.SiBSf2 

< JSC>TAGK3yTEBT/4/DENSEW00DLAND ,GSP f 1 
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<JSC>TAQKa/TRAIN/5.SCt5S;2 

<3ic>TASKa/TRAlN/5/HPODB.DOUTJ 1 

< J BC >TARK 3/ TRA I N/B/RHEAT » BOUT Jl 

< JGC>TAS;K3/TRAIN/0/8TAT. iB-QRPBf I 
<JSCJ>TASK0/TRAIN/5/6rAr.“DBNSEWW00DLAND/CUIPn 
» S0BA4 

<J8C>TASK3/TRAlN/S/BTAT,-MHEAT/CLrpn 

< JBC>TA8Ka/TRAlM/5/STAT * <-SOVBEAN8/CL I PM 
•4 

< JSC >TASK3/TRA IN/5/BTAT . -PABTURE/CLI P 1 1 
<JSC5‘TABK3/TRA1N/S/8TAT.~HAV/CLIPM 
<J8C>TASKa/TRAlN/0/srATi*«C0RN/CUPf2 
<JSC>TABK3/TRAIN/1B/8PY8EANS,BQUTM 
<JS0>TASK3/TRAIN/5/PABTURE,aOUTjl 

< JSOTASK3/TRAIN/0/PACK . -NB/MOTB J I 
<JBC>TASK3/TRAIN/'3/PACK*~0ENSeW00DS/CLipn 
•044 

< JSOTASK3/TRA JN/5/PACK , «OTMeRHAV/CL I P I 1 
*4 

4J«C‘>TASK3/TRAIN/3/PACK.-S0YBEANS/CLiPM 

»4 

< JSCmSK3/TRA I N/5/PACK . ~PASTURE/CL I P M 

< JSOTASK 3/TRA lN/3/ PACK . -WHEAT/CL r P ;i 
^JSOrASKS/TRAIR/S/PACK.-CORN/CU PI 1 
<JSC>TA8K3/TRAIN/3/ISTAT. 18-GRP8M 
<J8C>TASK3/TRArN/3/HAV.B0UTM 
<JSC>TASK3/TRAIN/3/C0RN,B0UTI2 

<J8q>TASK3/TRAlN/S/PACK,-0THERHAY/M078M 


’*<JSC>TASK3/TRAIN/8/PACK.»BENSEWODDLAN0/MO37a|l 
♦ 20044 

< JSOTA8K3/TRAIN/5/PACK . -SOYBEANS/MC 79 M 


>4 

<JSC>TASK3/TRAIN/S/PACK.-PASTURE/M079M 

<JSC>TAr'‘K3/TRAlN/5/PACK.“mNTERl'IHEAT/M079;i 


#0044 

<JSC>TASK3/TRAIN/S/PACK.-CORN/h079l 1 
<.'SC>TASK3/TRAIN/8/PACK.NB/MQ79M 
<JSC>TASK3/TRAIN/5/C0MMAND.B0UTM 
< JSC >TA8K3/TRA I N/5/NJ NTERWHEAT . ESP M 
<JSC>TASK3/TRAIN/5/WINTERWHEAT.SGTI 1 
<JSC>TA8K3/TRAJN/S/rBL. M 
<JSC>TASK3/TRAIN/5/S0VBEANS,ESP| 1 
< JSC>TASK3/TRAJN/5/SDyBEANS .SGTM^ ^ 
s JSC>TASK3/TRAir'i/5/SENSEW0QDLAND .ESP 1 1 

< JSC;* j ASK3/TRAIN/5VPERHANENTPASTURE. ESP 1 1 

#53 . 

<JSC>TASK3/TRAIN/3/PERMANENTPASTURE.SGTM 

»53 

<JSC>TASK3yTRArN/8/0THERHAY.ESP;i 

< JSOTASK3/TRA 1 N/8/0THERHA^^ SGT; 1 
<JSC>TASK3/TRAlN/5/ISTAT.lG-GRPS/CLiP;l 
<JSC>TASK3/TRAtN/5yDENSEW00DLAND.SGTM 
<JSC>TASK3/TRAIN/0/CORN.ESPM 
<JSC>TASK3/TRAINy5/C0RN.SaTl I 
<JSC>TASK3/TRA1N/5/CAT. 1 1 




E-23 


<JSC>TASK3/TEST/5/WINTERWHEAr.S0Tn 

< JSC>TASK3/TES17l5/TBt.* J I 
<J0C>TABK3/TReT/5/C0VBEAN8.E8P;i 
<JSC>TAnR3/TGST/5/flOVBEANS.SQT;i 
<JCC>TASK3/TEaT/5/PBR«ANENTPASTURe.E8P;i 

»3 

< JSOTA5K3/TB8T/S/PERMANENTPASTURE . SQT ; 1 
»3 

<4BCmSK3/TE3T/S/0THERHAV.E6P J 1 
<J3C>TASK3/TEST/5/0THERHAV.S0m 

< JSG>TASK3/TEST/B/0ENSEW00Dt,AK'l), ESP,* I 
<JSe>TASK3/TESt/5/0ENSEWOOQt.AND,Sam 
<aBC>TASK3/TEST/'5/C0ftNrGSPM 
<JBC>TASK3/TE3T/B/C0RN,SQTn 

< JSOTA8K3/TEOT/3/CAT. n 
<,fBC>TA3K3/TE8T/3tStOSf2 
<4SC5^1TA5K3/TESf/B/PACK*NB/HD7SH 
<4SC>TASK3/‘fEBt/3/C0HMANb .BOUT! 1 
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< JCC>TAiK3/TRA IN/O/WQORB . BOUT J 1 

< JSOTAiKa/mAIN/6/WHEAT . BOUT ? 1 

< JBG5>TASK3/TRAIN/B/STAT . 17-QRPS n 
<J8C>TABK3/TRAlN/O/STAT,-W0ODii/CLIP;i 
< JCC>TA5R3/TRAXN^B/BTAT , -WHBAT/CU I P ? J 

< 48C >TA6K3/TRA IN/8/8TAT . -SOVBEANS/CL I P ?i 
«4 

<4SC5'TASK3/TRA IN/8/STAT * -PABTURE/CLIP f I 
< J6C>TA8KgyTRAIN/e/STAT , "OTHERHA V/CLI P f i 

1de6^fMMi^lMIWe595cRf5e'?li6GVIf^ 

< J8C>TASK37TRAIN/e/PASTURE , BOUT i 
<JSC>TASKa/TRAIN/e/PACK.-OTHERHAY/CLIP;i 

#4 

<JSC>TA8K3/TRAIN/B/PACK*-W0aDS/CLlPM 

<JSC>TA8K3/TRAlN/B/PACK,-B0VBEAN8/CLIP;i 


<JSC>TASKa/TRAIN/B/PACK»-PERHANeNTPABTURl!/t5Cl Hi 1 
nd 20044 

< JSOTASK3/TRA1N/B/PACK , -mNTERWHBAT/CLXPf 1 


<4GC>TA8K3/TRAIN/B/PACK .-CORN/CL.I P » 1 

< jsC>TASK3/TRAi N/S/PACK . -m/H07Q » 2 
< JSC>TA5K3/TRAIH/0/HAY.BQUTi 1 

7 .ir,r»!«TASK3/Tr?A I N/G /CORN » BOUT i i 

< JeOTASKS/TRAlN/B/BENBEWOODLAND . ESP U 

< JBC>TASK3/TRAIN/B/DENSEMOOD1,ANO .BBT f 1 


<JGC>TASK3/TRAIN/B.SEaSi2 
<aSC>TASKa/TRAlN/e/PACK,NB/A07S?E 
< JGS>TASK3/TRAIN/G/I afAT * I 7“0 rPS » 5 
<JSC>TASKO/TRAIN/G/COf1MAND.0OUT;i 
< J8C>TASK3/TRAIN/G/PACK .~aTHERHAy/M07a; J 
J»4 . 

< JSOTASK3/TRAIN/G/PACK . “DENSEW0qDUAND/M073 i I 
* 20B44 

< JSOTASK3/TRA IN/G/PACK . -SQYBEANS/MOTS i 1 

<JSOTAGK3/TRAIN/G/PACK. ‘^PERMAN'iNTPASTURE/MOTSi 1 
•«nd 20B44 

< JSOTASK3/TRAIN/6/PACK .~WINTERNHEAT/N07B; 1 
>#0B44 

< JBC>TAGK3/TRAIM/0/PACK , »-CQRN/M073 i 1 
<JSC> I ASKG/TRAIN/G/WINTERWHEAT. SGTf 1 
<JSC>TASK3/TRArN/G/TBL, U 
sJGOTASKG/TRAIN/G/TBL, , J2 
<JGC>TASK3/TRAJN7G/S0YBEANS.ESP;i 
<JGC>TASK a/TRAlN7S/S0YBEANB.SGT;i 
<J5C>TASK37TRAIN/G7 PGRMANENTPASTURE.ESp;1 

#53 

<>IGC>TASK3/TRA1N/G/PERMANENTPASTURE. SBTi 1 
#53 

< JSC>TASK37TRA J N/B/QTHERHAV . ESP ? 1 
<JSC>TASK37TRAIN/G/OTHERHAY.SOT; 1 
<JSC>TASK37TRAlN/G/lSTAT.17“GRPS/CLIPfl 
<JSC>TASK37TrWtrN/G/C0RN.ESPJi 
<JSC>TA8K3/TRAIN7G/CaRN.SGT;i 
< JSC>TASK3/tRAIN7G/CAT. f 1 
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< JSOTASKa/TEST/B/PACK . ~NB/M079n 
< JSC>TASK37TEST/e/PACK . NB/M079 J 2 

< JSOTASK3/TEST/C/C0MMAND . BOUT I 
<JSC>TASK3/TEST/B/WINTERWHEAT.ESPM 
<JSC>TASK3/TEST/S/W1NTERWHEAT.SGT?1 
<JSC>TASK3/TEST/B/TBL. ; 1 

< JSOTASKO/TEST/B/SOYBEANS.EBP; 1 

<jsc>tabk3/test/g/sovbeans.sgt;i 

<jaC>TASK3/TEST/B/PERMANENTPASTURE.ESP;i 

«3 

< JSO TASK 3/ TEST/B / PERMANENTPASTURE . SOT » I 
#3 

<jsg>task3/test/g/dtherhay.sgt;i 

<JSC>TASK3/TEST7B/GTHERHAY.ESP; 1 

< JSOTASKO/TEST/B/DENSEWOODLAND . ESP M 
<\SSC>TASK3/TEST/B/DENSEM00DLAND.SQT;1 
<jaC>TA>K3/TESTy 6/CORN .ESP; 2 

< JSOTASK3/TEST/6/CORN . SGT ; 2 
< JSC>TASK3/TEST/e/CAT. ; 1 
<JSC>TASK3/TEST/B.SECS;2 


< JSOTASK3/TRA1N/7/PACK . NB/M070 ; 1 

< JSC>tASK3/TRflIN/7/W0DD8 . BOUT f 1 
<J5C>TnBK3/TRAIN/?/WHEAT.00UT; 1 
<JQC>TASK3/TRAIN/7/STAT.-lBGRPS/CLIP;l 
<JSC>TASK3/TRAIN/7/STAT.-'W00DS/CtIPJl 
<J5C>TASK3/TRAIN/7/STAT.-WINTERMHEAT/CLIP;i 

MOB44 

<JSC>TASK3/TRAIN/7/STAT.-80YBEANS/CLIPf I 

*4 

<JSC>TA5K3/TRAlN/7 /STAT. -pasture/clip; I 
<JSC>TASK3/TRAIN/7/£3TAT."HAY/CUPf 1 ' 

<JSC>TASK3/TRAIN/7/BTAt. -CORN/CLIP? I 
<J3C>TASK3/TRA1N/7/S0YBEANS.B0UT; I 
<JSC>TABK3/TRAIN/7/PASTURE,B0UTr t 
<J8C>TASK3/TRAlN/7/PACK.“0THERHAY/f1079?l 
*4 

<JSC>TASK3/TRAIN/7/PACK.“DENSEW00DLAND/M079;1 
« 20944 

<JBC>TASK3/TRAIN/7/PACK.-S0YBEANS/M079;1 

>4 

<JSC>TABK3/TRAIN/7/PACK.-PERMANENTPASTURE/M079;i 
»nd 20844 

<JSC>TASK3/TRArN/7/PACK.-WlNTERMHEAT/l1079;i 

*0944 

<JSC>TASK3/TRAIN/7/PACK.-CQRN/M079M 
<JSC>TASK3/TRAIN/7/PACK.-NB/t1079; I 
<J3C>TASK3/TRAlN/7/PACH,~0THERHAY/CLIP;i 
»4 

<JBC>TASK3/TRAIN/7/PACK.-W00DS/CUPJ 1 
<JBC>TASKa/TRAIN/7/PACK.-SQYBEANS/CLIP;i 
«4 

<.JSC>TASK3/TRAlN/7 /PACK. -pasture/clip; 1 
<JSG>TASK3/TRAlN/7/PACK.-WHEAT/CLlPr 1 

< J80TABK3/TRAIN/7/PACK. -CORN/CLIP ;i 
<JSC>TA3K3/TRAIN/7/lSTAT.-ie8RPS/CLIp;i 
<JSC>TASK3/TRA1N/7/HAY.B0UT; 1 
<JSC>TASK3/TRAIN/7/CQRN.B0UT; I 

< JSOTASK3/TRA IN/7/C0MMAND . BOUT i 
<JSC>TASK3/TRA1N/7/WINTERWHEAT.ESP;1 
<JSC>TASK3/TRAIN/7/WINTERWHEAT.BQTn 
<JSC>TABK3/TRA1N/7/TBL. ; 1 

< JSOTASK3/TRAIN/7/SOYBEANS.BGT; 1 
<JSC>TASK3/TRAIN/7/S0YBEANS.ESP;i 

< JSOTABK3/TRA IN/7/PERMANENTPASTURE . ESP ; 1 

<JSC>TASK3/TRAIN/7/PERMANENTPASTURE.SGT; 1 
«33 “ • - 

<JSO>TASK3/TRAIN/7/OTHERHAY.ESP; 1 
<JSC>TASK3/TRAIN/7/0THERHAY.SGT; 1 
<JSC>TASK3/TRAIN/7/ISTAT.-16QRPS/WITHNAMES;1 
«2QB53 

<JSC>TASK3/TRAIN/77ISTAT.-16GRPS/PUR;1 

< JBOTASK3/TRA I N/'7/DENSEW00DLAND . ESP i 1 
<JSC>TASK3/TRAIN/7/DENSEW00DLAND.SGT;1 

< JSOTASK3/TRAIN/7/CORN.ESP; 1 

< JSOTASK3/TRAIN/7/CORN.SGT; 1 
<JSC>TASK3/TRAIN/7/CAT. 1 

< JSC>TASK3/TRAIN/7.SECS;2 
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<JSC>TASK3/TKBT/7/WINTERWHeAT.E:SPrl 

< JSC>TASK3/Te3T/7/mNTEf?WHeAT . SOT f 1 
<JSC>TASK3/TEST/7/TBL. ;a 
<JSC>TASK3/TEST/7/S0V0EANS.E8P;i 
<JSCMASK3/TEST/7/S0yBEANS»SGT; i 

< 4SOTASK3/TEST/7/PERMANENTPASTURE . SaTl t 
«3 

< JBOTASK3/TEST/7/PERMANENTPASTURE . ESP ! 1 
#3 

<JSC>TA8K3/TEST/7/0THERHAY.ESP! I 
< JSC >TASK3/TEST/7/0THERHAY . SOT ; 1 
<JSC>TASK3/TEST/7/1)ENSEW00DLAND.ESPM 
<JSC>TASK3/TEST/7/DENSEH00DL.ANDiSGTf 1 
<JSC>TASK3/TEST/7/CORN.ESP; I 
< jsc;task3/test/7/cqrn.sqt; 1 

< JSC>TnSK3/TEST/7/CAT. ; 1 
<JSC>rASK3/TEST/7.SEG5,*2 

< JSOTASK3/TEST/7/PACK .NB/M07S; I 
^JSC>TASK3/TEST/7/CDMMAND.B0UTf I 
<JSC>TASK3/TEST/7/PACK.-NB/M079J i . 
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< JSC>TASK3/Tf^A IN/D * QI-GD ; 2 
<JSa>TASK3/TRAlN/Q/W00DS.B0UT? 1 

< JSOTASK3/TRA IN/O/WHI- AT . BOUT f 1 
<J5C>TASK3/TRAIN/B/STAT.-l50RPS/CLIP;i 
<JSC>TASK3/TRAIN/a/STAT.-aTHERHAYyGLIPM 

*4 

< JSOTASK3/TRAIN/8/STAT .‘-DENBEWOODLAND/CLI P ; 1 

# 2004 4 

<JSG>TASK3/TRAXN/8/STAT,"S0YBEANS/CLIPr 1 

#4 

<JSC>TASK3/TRArN/0/STAT.-PERMANENTPASTURE/CLIP;i 
#nd 20044 

<JSC>TASK3yTRAIN/8/STAT."WINTERHHEAT/CLlP; I 
«0Q44 

<JQG>TA8K3/TRAIN/a/STAT,--C0RN/CLIPri 
<JSC>TABK37TRAIN/8/S0YBEANS.D0UTM 
<JBC>TASK3/TRAIN/8/PASTURE.B0UTJ1 
<JSC>TASKa/TRAlN/8/PACK.-0THERHAY/M079M 
"If 4 

<JSC>TASK3/TRA1N/8/PACK.-DENSEW00DLAND/M073;1 

# 20844 

<JSC>TASK3/TRAIN/B/PACK.-S0VBEANS/ri078M 

#4 

<JSC>TASK3/TRAl‘N/B/PACK.-PERMANENTPASTURE/H07Sri 
«nd 20844 

<JSC>TASK3/TRAIN/B/PACK.-WINTERWHEAT/MD73f 1 
«0844 

<JSC>TASK3/TRAIN/a/PACK.“CORN/MQ7&;i 

< JSC>TASK3/TRAIN/B/PACK . “OTHERHAY/C|,IP r 1 
*4 

< JSOTASK3/TRAIN/8/PACK .-DENSEWDODLAND/GLIP; 1 
» 20844 

<JBC>TASK3/TRAlN/a/PACK,-SaYBEANB/CLiP; 1 
»4 

<JSC>TASK3/TRAIN/8/PACK.-PERMANENTPASTURE/CLIP; 1 
Knd 20844 

<JSC>TASK3/TRAIN/8/PAGK,-C0RN/CLIP; i 
< JSG>TASK3/TRAIN/8/PAGK . -HINTERWHEAT/GLIP J 1 
*0844 

< JBOTASK3/TRAIN/B/PACK . -NB/M079; t 

<JSG>TAaK3/TRArN/8/ISTAT.-*15CRPS/GLIPM 
<JSC>TASK3/TRAIN/8/HAY.B0UT;1 
<JSC>TASK3/TRAIN/8/C0RN.BQUT;i 
<JSC>TASK3/TRAIN/8/BOMMAND.BOUT; 1 • 

<JSG>TASrv3/tRAlN/8/WHEAT.B0UT; 1 
<JSC>TASK3/TRAJN/8/aTAT.-WINTERWHEAT/CUP; 1 

*0844 

<JSC>TASK3/TRArN/8/PACK.NB/M079M 

<JSG>TASK3/TRAIN7a/WlNTERWHEAT.ESP;i 

<JSC>TA8K3/TRAlN/87mNTERWHEAT.SGT;i 

< JBOTASKO/TRAIN/a/TBL. ; I 
<JSC>TASK37TRAIN/8/80YBEANS.ESP;1 
<JSG>TASK3/TRAIN787SQYBEANS.SGT; 1 
<JSG>TABK3/TRAIN/87PERtlANENTPASTURE.E8P; 1 

*53 

<JSC>TASK37TRAIN/e7PERMANENTPABTURE.SGT;i 

*53 
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<JSC>TASK3/TRAlN/0/OTHERMAY.SaTM 

<JSC>TASK3/TRAINYB/QTHERHAY.ESPM 

<JSC>TASK3/TRAIN/8/ISTAT.-lSGRPS/WlTHNAMES;i 

♦20QS3 

<JSC>TASK3/TRAlN/0/rSTAT.-lSGRPS/PURM 

< JSOTASK3/TRA IN/8/DENSGWOODLAND . ESP M 

< JSOTASK3/TRA IN/B/DENSEI')OODLAND . SGT ! t 
<JSC>TASK3/TRAIN/B/C0RN.ESP; 1 
<JSC>TASK3/TRAlN/8/G0RH.SGTI 1 

< JSOTASK3/TRA1N/B/CAT. i 1 


< JSC >TASK3/TEST/B / PACK . -ND/M079 ; I 

< JSOTASK3/TEST/B/WOODS.EST; 1 

< JSOTASK3/TEST/0/W00DS. SQTM 
<JSC>TASK3VTEST/B/WHEAT.EST; I 
< JSC>TASK3yTEST/8/WHEAT.SQTJ 1 

< JSOTASK3/TEST/8/TABLE. ; I 

< JSOTASK3/TEST/0/PACK . NB/MQ79J 1 
< JSC>TASK3/TEST/B/C0MMAND.B0UTj 1 

< JSOTASK3/TEST/B/B0YBEANS.EST; t 

< JBOTASK3/TEST/8/SQYBEANS.SDT; i 

< JSOTASK3/TEST/ 8/ PASTURE . EST J 1 
< JSC>tASK3/TEST/8/PASTURE.SGT; 1 

< JSOTASK3/TEST/8/HAV.ESTJ I 

<jsc>task3/test/b/hay.sgt;i 

< jsotasks/test/b/corn.est; 1 

<JSC>TASK3/TEST/B/C0RN,SQTJ1 
<JSC>TASK3/TEST/B/CAT.il ' 

< JSOTA8K3/TEST/8 . BEGS ; 2 


<JSC>TASK3/TRAIN/9.CEGS;S 

< JSOTASKa/TRAIN/S/STAT. 16-GRPS* 1 
<JSC>TASK3/TRAIN/9/'STAT.-QTHERHAY/CUPM 

»4 

<JSC>TASK3/TRAIN/9/STAT.-DENSEW00DLAND/CLIP;t 

# 20044 

<JSC>TASK3/TRAIN/9/STAT,'.'SaYBEANS/CLIP;i 

#4 

<J5C>TASK3/TRAJN/9/STAT.-PERMANENTPASTURE/CLXP»1 
#rid 20B44 

< aSC>TA3K3/TRAlN/9/STAT.-MINTERWHEAT/CLip; t 
l!-0B44 

<JSC5*TASK3/TRAIN/9/STAT. -corn/clip; 1 
<JSC>TASK3/TRAIN/9/PACK.NB/Ma79M 
<JSC>TASK3/TRAIN/9/ISTAT.16-GRPS;i 
<JSC>TASK3/TRAIN/9/C0MHAND.B0UT; 1 
<JSG>TASK3/TRArN/9/W00DS.ESTJl 
<JSC>TASK3/TRAIN/9/W00DS.SQTM 
<JSC>TASK3/TRAIN/9/NHEAT.ESTM 
< JSC>TASK3/TRAIN/9/WHEAT.SQT; 1 
< JSC>TASK3/TRAIN/9/TABLE.;i 

< JSOTASK3/TRA IN/9/S0YBEANS . ESTI 1‘ 
<JSC>TASK3/TRAlN/9/S0YBEAN9.SQTJl 

< JSC>TASK3/TRA I N/9/PASTURE . EST 1 

< JSOTASK3/TRAIN/9/PASTURE.SGT; I 

< JSOTASK3/TRAIN/9/ISTAT. IB-GRPS/'CLIPri 
< JSC>TASK3/TRAIN/9/HAY.ESTf 1 

< JSC>TABK3/TRAlN/9/HAi'.SGT? 1 
<JSC>TASK3/TRAIN/9/C0RN.EST; 1 
<JSG>TASK3/TRAIN/9/C0RN,'4GTJt 

< JSC>TASK3/tRAXN/9/CAT. ; 1 
<JBC>TASK3/TRAIN/0/WOODS.BOUTM 
< JSC>TASK3/rRArN/9/WHEAT»B0UT; 1 

< JSOTASK3/TRAIN/9/SOYBEANS.BQUT; 1 
<JSC>TASK3/TRAlN/9/PASTURE.B0UTM 

< JSOTASK3/TRA1N/E/PACK .-DTHERHAY/H07g; 1 

<JSC>TASK3/TRAIN/9/PACK.-DENSEWaDDLAND/MD79!l 

♦ 20844 

< JSw'>TASK3/TRAIN/9/PACK,-S0YBEANS/MQ79; I 
»4 

<JSC>TASK3/TRAIN/9/PACK.-PERMANENTPASTURE/M079M 
*iid 20844 

<JSC>TA8K3/TRAIN/9/PACK.-WINTERWHEAT/M079;1 

»0B44 

< JSOTASK3/TRAIN/9/PACH .-C0RN/MD79ji 

< JSOTASK3/TRAIN/9/PACK . -QTHERHAY/CLIP J 1 
♦4 

<JBCMASK3/TRAIN/9/PACK.-DENSEW00DLAND/CLIP;1 

* 20S44 

<JSOTASK3/TRAIN/9/PACK. -soybeans/clip; I 
:*4 

< JSOTASK3/TRAIN/9/ PACK .-PERMANENT PASTURE/CL IP i 1 
*nd 20844 

<JSC>TASK3/TRAIN/9/PACK.-HlNTERWHEAT/CLIPM 

*0844 

<JSC>TASK3/TRAIN/9/PACK.-C0RN/CLIP; 1 

< JSOTASK3/TRAIN/9/PACK.-NB/M079; 1 

< jsotabks/train/s/hay.bdut; I 
<JSC>TASK3/TRAIN/B/C0RN.BDUT;1 


E-32 








< J sc >TASK3 / TEST/ 3 . SEQS ; 2 

< JSC>TnSK3/TEST/0/PACK . -ND/M07D ; I 

<JSC>TASK3/TEST/0/PACK.NB/f107S;i 

<4SC>TA8K3/TEST/S/C0|1MAND.00UT;1 

< JSC>TASK3/TEST/a/W00DS » EST.* 1 

< JSC>TASK3/TEST/9/W0DiIS . SGT f I 
<JSC>TASK3/TBST/9/WHEAT.E0T.;i 

<jsc>task3/test/9/wheat.sot;i 

< JSOTASK3/TEST/9/TABLE. M 

< JSC >TASK 3/TEST/9/SQVBEANS . EST J I 
<JSC>TABK3/TE5T/9/B0YBEANS.SaT;i 

< JSOTASK3/TEST/S/PASTURE.EST; 1 
< JSC>TASK3/TEST/9/PASTURE.SaTJ 1 
<JSC>TASK3/TEST/3/HAY.SGTf 1 
<JSC>TASK3/TEST/9/HAY.EST?l 

< JSC>TABK3/TEST/g/caRN.EBT; 1 

< JSOTASK3/TEST/9/GORIM. SaTf 1 
<JSC>TASK3/TEST/9/CAT. ; 1 



< JSOTASK3/Tf?AlN/ lO/UOODS . DOUT; 1 
<JSC>TASK3/TRAIN/J0^WHEATJ30UTU 

< JSOTASK3/ TRA I N/ 1 0/SO YBEANS . BOUrn 

< J SOTASK 3/ TRA IN/ 1 0/ PASTURE . BOUT 1 1 
<JSC>TASK3/TRA1N/10/PACK."QTHERHAV/CLIP;1 
»44 

< JSOTASK3/TRA IN/ 1 0/PACK . -DENSEWOODLAND/CL I P ! 1 
t 20B44 

< JSOTASK3/TRAIN/IO/PACK .-SOyBEANS/CUPIi 

♦ 44 

< JGOTASK3/TRAIN/ 10/PACK. -PERMABNENTPASTURE/CLIPIl 

♦ and 20844 

<JSC>TASK3/TRAIN/1 0/PACK . -WINTERWHEAT/CL I Pfl 
►20044 

<JBC>TASK3/TRAIN/ 10/PACK. “CORN/CLIP M 
<JSC>TASK3/TRAIN/10/HAV.BOUTM 
<JSC>TASK3/TRAIN/10/C0RN.B0UTM 
<JSC>TASK3/TRAlN/10/PACK.-0THERHAy/M079M 

#44 

<JSC>TASK3/TRAIN/10/PACK.-DENSEM00DLAND/M079f 1 

♦ 20044 

<JSC>TASK3/TRAlN/10/PACK.-SOyBEANS/H079ri 

#44 

<JSC>TASK3/TRAIN/10/PACK.-PERHANENTPASTURE/H079II 
«and 20044 

< JSC>TASK3/TRAIN/iO/PACK .-MINTERMHEAT/Ha79 I I 
#20044 

<JSC>TASK3/TRAIN/10/PACK.-C0RN/H079M 
<JSC>TASK3/TRAIN/10/PACK.-NB/M079M 
<JSG>TASK3/TRA1N/10/W00DS.ESTM 
<JSC>TASKi3/TRAlN/10/W00DS.SCT;i 
<jSC>TASK3/TRAlN/10/WHEAT.ESTM 
<JSC>TASK3/TRAIN/10/WHEAT.SGTM 
<JSC>TASK3/TRAIN/10/TABLE.M 
<JSG>TASK37TRAIN/10/STAT.-15GRPS/EPM 
<JSC>TASK3/TRAIN/10/STAT.-0THERHAy/CLIP; 1 
#44 

<JSC>TASK3/TRAIN/10/STAT.*-DENSEW00DLAND/CLIPM 
» 20Q44 

<JSC>TASK3/TRAIN/10/STAT.-S0yBEANS/CLIPII 

#44 

<JSC>TASK3/TRA1N/10/STAT.-PERMANENTPASTURE/CLIPM 
fand 20044 

<JSC>TASK3/TRAIN/10/ S t AT . - W I NTER WHE AT/ CL I P I I 
^#20844 

<JSC>TASK3/TRAIN/10/STAT. -corn/clip; 1 
<JSG>TASK3/TRAIN/10/S0yBEANS.ES'^M • 

<jsc>task3/train/io/sovbeans.sgt;i 

<JSC>TASK3/TRAIN/10/PASTURE.ESTn 

< JSOTASK3/TRAIN/ 10/PASTURE. SGTJl 

< JGOTASK3/ I RA IN/ 1 0/PASTUPE . bout; 1 
<JSC>TASK3/TRA IN/1 0/PACK. NB/M079;i 
<JSC>TASK3/TRAIN/10/ISTAT.-15GRPS/EPM 
< JGC>TASK3/TRAIN/10/HAy.EST; 1 
<JSC>TASK3/TRAIN/ 10/HAY. SOT M 

< JSC'/TABK3/TRAIN/10/CCRN.EST; 1 
<JSC>TASK3/TRAIN/10/caMt1AND.B0UT;i 
<JSC>TASK3/TRAIN/10/CAT. ri 
<JSC>TASK3/TRAIN/10.SEGS;2 

< JSC>TASK3/TRAIN/10/JSTAT.~15GRPS/PURM 
<JSC>TASKK3/TRAIN/10/C0RN. SGTJl 


< J PC >T ASK 0 /TEST/ 10/ WOODS . EST f 1 

< JSOTASK3/TEST/ 1 0/WODDS . SGT J 1 

< JSOTASK3/TE817 10/WHEAT.EST; 1 
<JSq>TASKO/TEST/lO/WHKAT.BQTf I 

< JSOTASKn/TEST/ lO/TABLC, ? I 
<JSC>TASK3/TEST/10/S0YSEANS,EST;1 

<jsc>task3/test/io/sovbeans.sot ; i 

<JSG>TASK3/TEST/10/PASTURE.EST;1 

<JSC>TASK3/TEST/lO/PAStURG.SaT;i 

<JGC>TASR3/TEST/10/PACK.NQ/H079;1 

< JBOTASKO/TEST/I 0/HAY . SGT! 1 

< JSOTASK3/TEST/ 1 0/HAY . SOTf 2 

< JSOTA8K3/TEST/10/CORN. ESTf 1 

< JSOTASK3/TEST/10/C0RN. SGT; I 
<JSC>TASK3/TEBT/lO/CDMMAND.BdUTIl 
<JSC>TASK3/TEST/10/CAT. ? 1 

< JSOTABK3 / TEST/ 1 0 , BEGS J 2 

< JBOTASK3/TEBT/1 0/HAY , EST i t 
<JBU>TASK3/TEST/ 10/PACK .-ND/MQ79; t 


< JSOTASK3/TRniN/n /TABLE. IS 
<jac>TASKa/TRAIN/U/STAT.-l6eRPS/CLIPM 
<JSC>TASK3/TRAJN/ll/STATi--DENSEHH0DUAN/CLIp;i 

^ 20044 

<jaC>TABK3/TRAIN/ll/SrAT.-HINTERWHEAT/CLIP;i 

»20Q44 

<JSC>TA3K3/TRAIN/U/BTAT.-S0YBEANQ/CLIPn 

#44 

<JGC>TASK3/TRAIN/U/STAT.^PERHANENTPASTURE/CLIP;1 
*und 20B44 

< JBOTASK3/TRA IN/ ii /S r AT. **0THERHAY/CL I P J I 
»44 

<JSC>TASK3/TRAIN/U/STAT.-C0RN/CUIPM 
< JS0>TASK3/TRAIN/1 l/SQYBEANS.BaUTI 1 
<JSC>TASK3/TRAIN/ 11 /PASTURE. bout; I 
<JBC>TABK3/TRAIN/ll/PACK.-0THERHAY/CLtP;i 
*44 

<JSC>TASK3/TRAIN/11/PACK.-DENSEW00DS/CLIP;i 

#0044 

< JSOTASK3/TRAIN/ 1 1 /PACK . -60YBEANS/CLI PI 1 
#44 

<JSC>TASK3/TRAIN/1 1/PACK. “PERMANENTPASTURE/CLIP; I 
#and 20044 

< JSOTASK3/TRA1N/ 1 1 /PACK . -W I NTERWHEAT/CL I P ; 1 
•#S0B44 

<JSC>TABK3/TRAIN/ll/PAnK.-C0RN/CLXPIl 
<JSC>TASK3/TRAIN/1 1/ISTAT.“1BGRPS/CLIP;1 

*#4 

<JSC>TASK3/TRAIN/ 1 1 /HAY. BOUT! 1 
< JSOTASK3/TRAIN/ 1 1 /CORN. BOUT! 1 
< J0C>TASK3/TRAIN/11 /WOODS. BOUTrl 

< JSOTASK3/TRAIN/ 1 1 /WHEAT. BOUT ! 1 
<JSC>TABK3/TRAIN/1 1/PACK.-0THERHAY/H073; 1 

*44 

<JSC>TASK3/TRAIN/11/PACK.-S0YBEANS/MD79;1 

*44 

< JSOTASK3/TRAIN/ 1 1 /PACK .-DENSEW00DUAND/MO79! I 

* 20044 

<JSC>TASK3/TRAIN/1 1/PACK. -PERMANENTPASTURE/M073f 1 
*ah<l 20044 

< JSOTASKS/TRAIN/ 1 1 /PACK .-WINTERWHEAT/H079 ; 1 
420844 

< JSOTASK3/TRA IN/ 1 1 /PACK . -caRN/M079l 1 
<JSC>TA0K0/TRAIN/1 1/PACK. -NB/MQ79; 1 
<JSC>TASK3/TRAIN/il/W0QDS.EST?l 

< JSC>TASK3/TRAIN/ll/WaODS.SQT; 1 
<JSC>TASK3/TRAIN/1 1 /WHEAT. ESTM 
< JSC>TASK3/TRAiN/ 1 1 /WHEAT. SGT! I 
<dSC>TASK3/TRArN/ll/TABLE.! 1 
<JSG>TASK3/TRAIN/ 11 /SOYBEANS .EST! 1 
< JSC >TASK3/TRA IN/ 1 1 /SOYBEANS .SGT; I 
<JSC>TASK3/TRAIN/ 1 1 /PASTURE. EST! 1 

< JSOTASK3/TRAIN/ 11 /PASTURE. SGTIl 

< JSOTASK3/TRAIN/11/PACK.NB/H079I1 

< JSOTASK3/TRA IN/ 1 1 / 1 STAT . -1 GGRPS/PUR! 1 
<JSC>TASK3/TRAIN/ll/riAY.ESTIl 
<JSC>TASK3/TRA IN/1 1 /HAY. SGTIl 

<4SC>task3/train/ii/corn.est;i 

<JSS>TASK3/TRAIN/11/C0RN.SGT!1 
<JSC>TASK3/TRAIN/ 1 1/COMNAND .BOUT II 
<JSOTASK3/TRAIN/ll/CAT. ;i 
<JSC>TASK3/TRAIN/11.SEGS;2 
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< JBOTASK3/TEST/1 1/WOQDS.ESTJ 1 
<JSOTASK3/TEST/l 1 /WOODS. sot; I 
<J0C^TASK3/TEST/l 1/WHEAT. EST; I 

< JSOTASK3/TEST/ 1 1 /WHEAT . SOT ; 1 
<J8C>TA8K3/TEST/ll/TABUB.;i 

< J80TA8K3/TEST/1 i /SOYBEANS. EST? 1 

< JSOTASK3/TEST/ 11 /SOYBEANS. SOT ;i 
<JSC>TASK3/TEST/1 1/PASTURE. EST;1 
<JSC>TASK3/TEST/1 1 /PASTURE. sot; 1 
<JSOTASK3/TEST/l 1/PACK. NB/M070;i 

< J80TA8K3/TEBT/ 1 1 /HAY . EST 1 1 

< JSOTASK3/TEST/ 1 1 /HAY . SQTl I 

<jsc>task3/test/u/corn.est;i 

<JSC>TASK3/TEST/1 1/CORN. sot; I 

< JSOTASK3/TEST/1 1 /COMMAND. bout; 1 

<J8C>TASK3/TEST/11/CAT. ?1 ‘ 

<J8C>TASK3/TEST/11.SE0S;2 







* u.s, OOVCHNMeNT PWINT1NO OTFICC: t0«t— 771-014/10*8 
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